-- Logs begin at Mon 2022-07-04 08:35:10 UTC, end at Mon 2022-07-04 09:39:46 UTC. -- Jul 04 09:10:36.558115 dv-cinder-844563-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 09:10:36.566237 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 09:10:36 2022] *** Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: nodename: dv-cinder-844563-4-iscsi Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: machine: x86_64 Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: clock source: unix Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: pcre jit disabled Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: detected number of CPU cores: 4 Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: current working directory: / Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: detected binary path: /usr/bin/uwsgi-core Jul 04 09:10:36.568281 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: your processes number limit is 47680 Jul 04 09:10:36.569614 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: your memory page size is 4096 bytes Jul 04 09:10:36.569614 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: detected max file descriptor number: 2048 Jul 04 09:10:36.569614 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: lock engine: pthread robust mutexes Jul 04 09:10:36.569614 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: thunder lock: enabled Jul 04 09:10:36.569614 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 09:10:36.569614 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 09:10:36.612955 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: Python main interpreter initialized at 0x56421a2b49c0 Jul 04 09:10:36.612955 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: python threads support enabled Jul 04 09:10:36.612955 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: your server socket listen backlog is limited to 100 connections Jul 04 09:10:36.612955 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: your mercy for graceful operations on workers is 90 seconds Jul 04 09:10:36.613361 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 09:10:36.613448 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: *** Operational MODE: preforking *** Jul 04 09:10:36.613644 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: *** uWSGI is running in multiple interpreter mode *** Jul 04 09:10:36.613644 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: spawned uWSGI master process (pid: 103144) Jul 04 09:10:36.613837 dv-cinder-844563-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 09:10:36.617779 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: spawned uWSGI worker 1 (pid: 103145, cores: 1) Jul 04 09:10:36.617779 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: spawned uWSGI worker 2 (pid: 103146, cores: 1) Jul 04 09:10:36.617779 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 09:10:37.282971 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 09:10:37.283820 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 09:10:38.419801 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:10:38.419801 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: from cryptography.utils import int_from_bytes Jul 04 09:10:38.420413 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:10:38.420413 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: from cryptography.utils import int_from_bytes Jul 04 09:10:38.442338 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:10:38.442338 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: from cryptography.utils import int_from_bytes Jul 04 09:10:38.442830 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:10:38.442830 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: from cryptography.utils import int_from_bytes Jul 04 09:10:40.880641 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:10:40.881278 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:10:40.881424 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:10:40.881788 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:10:40.882041 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:10:40.882424 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.882748 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.883068 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.883388 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.883715 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.884022 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.884337 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.884653 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.884974 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.885257 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.885355 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:10:40.885705 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.885792 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:10:40.885877 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-4-iscsi {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.886089 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:10:40.886185 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.886448 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:10:40.886554 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.886699 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:10:40.886786 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.887059 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.887154 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.887362 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.887454 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.887679 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.887764 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.887978 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.888065 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.888296 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.888471 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.888584 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.889638 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.889784 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.889900 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.889987 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.890113 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.890194 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.890194 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.890406 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.890496 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.890583 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.890661 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-4-iscsi {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.890739 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.890872 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.890954 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.891032 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.891160 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.891246 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.891332 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.891553 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.891640 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.891852 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.891989 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-4-iscsi {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.892166 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.892303 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.892470 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.892607 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.892912 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.893087 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.893349 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.893436 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.893656 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.893760 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.893963 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.894091 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.894279 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.894395 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.894597 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.894709 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.894903 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.895013 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.895226 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.895383 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.895541 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.895645 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.895856 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.895943 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.896192 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.896317 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.896478 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.896788 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.897119 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.897219 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-4-iscsi {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.897436 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.897533 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.897737 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.897822 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.898039 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.898175 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.898286 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.898477 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.898573 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.898797 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.898928 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.899094 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.899193 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.899415 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.899502 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.899732 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.899816 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.899977 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.900066 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.900278 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.900372 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.900592 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.900691 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.900895 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.900980 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.901223 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.901324 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.901527 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.901625 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.901828 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.901913 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.902130 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.902213 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.902431 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.902529 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.902728 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.902826 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.903031 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.903143 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.903279 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.903378 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.903577 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.903676 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.903892 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.903978 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.904205 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.904300 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.904520 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.904614 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.904768 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.904906 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.905014 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.905162 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.905349 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.905470 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.905661 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.905805 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.905962 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.906119 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.906265 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.906424 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.906565 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.906741 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.906864 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.907058 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.907164 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.907361 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.907465 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.907665 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.907751 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.907966 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.908052 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.908281 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.908380 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.908612 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.908698 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.908915 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.909008 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.909190 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.909290 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.909489 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.909575 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.909790 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.909926 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.910103 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.910198 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.910403 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.910488 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.910702 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.910800 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.911004 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.911102 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.911300 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.911399 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.911600 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.911685 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.912411 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.912713 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.912903 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.913017 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.913254 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.913354 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.913571 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.913659 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.913882 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.913969 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.914202 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.914332 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.914500 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.914592 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.914813 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.914899 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.915064 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.915148 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.915364 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.915450 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.915664 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.915758 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.915979 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.916083 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.916276 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.916370 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.916576 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.916670 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.916877 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.916971 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.917196 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.917285 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.917499 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.917585 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.917800 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.917894 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.918098 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.918184 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.918396 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.918479 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.918695 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.918789 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.918993 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.919086 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.919294 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.919380 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.919585 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.919683 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.919886 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.919981 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.920196 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.920281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.920499 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.920598 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.920797 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.920881 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.921117 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.921221 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.921417 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.921512 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.921713 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.921799 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.922017 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.922103 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.922311 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.922404 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.922609 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.922701 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.922903 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.922988 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.923207 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.923300 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.923507 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.923592 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.923813 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.923906 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.924111 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.924197 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.924411 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.924497 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.924721 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.924813 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.925014 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.925118 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.925336 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.925422 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.925647 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.925731 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.925947 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.926045 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.926245 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.926330 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.926542 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.926703 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.926839 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.926925 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.927134 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.927219 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.927483 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.928105 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.928407 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.928723 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.928847 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.929059 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.929163 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.929370 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.929466 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.929702 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.929803 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.930010 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.930096 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.930325 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.930420 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.930634 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.930720 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.930941 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.931041 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.931258 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.931343 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:10:40.931572 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.931686 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.931889 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.931984 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.932216 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.932301 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.932537 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.932621 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.932848 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.932944 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.933205 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.933303 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.933524 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.933612 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.933835 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.933935 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.934149 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.934235 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.934475 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.934560 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.934784 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.934878 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.935092 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.935185 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.935399 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.935491 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.935714 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.935808 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.936030 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.936124 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.936339 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.936431 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.936655 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.936740 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.936962 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.937081 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.937299 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.937395 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.937607 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.937705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.937917 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.938003 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.938226 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.938310 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.938540 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.938626 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.938847 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.938928 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.939158 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.939241 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.939467 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.939554 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.939784 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.939876 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.940094 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.940194 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.940402 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.940487 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.940707 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.940797 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.941010 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.941173 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.941341 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.941426 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.941645 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.941728 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.941957 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.942052 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.942262 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.942355 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.942577 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.942661 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.942882 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.942975 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.943231 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.943562 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.943654 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.943872 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.943966 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.944184 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.944272 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.944495 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.944624 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.944806 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.944905 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.945137 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.945280 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.945449 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.945598 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.945761 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.945908 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.946064 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.946223 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.946387 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.946532 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.946698 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.946840 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.947002 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.947133 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.947323 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.947437 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.947629 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.947723 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.947932 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.948025 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.948244 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.948337 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.948555 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.948643 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.948864 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.948949 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.949194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.949282 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.949507 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.949596 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.949827 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.949913 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.950138 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.950223 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.950444 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.950539 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.950754 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.950841 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.951062 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.951147 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.951364 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.951451 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.951673 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.951766 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.951979 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.952078 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.952280 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.952373 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.952586 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.952670 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.952891 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.952984 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.953215 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.953303 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.953519 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.953652 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.953826 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.953926 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.954124 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.954215 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.954425 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.954520 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.954729 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.954827 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.955031 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.955124 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.955333 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.955418 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.955634 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.955720 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.955950 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.956042 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.956254 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.956339 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.956554 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.956640 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.956856 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.956940 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.957185 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.957276 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.957507 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.957602 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.957817 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.957902 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.958134 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.958217 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.958445 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.958532 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.958828 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.958978 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.959147 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.959458 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.959585 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.959773 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.959907 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.960081 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.960217 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.960391 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.960524 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.960699 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.960836 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.961007 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.961167 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.961347 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.961473 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.961657 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.961776 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.961973 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.962080 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.962282 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.962367 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.962602 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.962688 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.962909 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.963002 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.963225 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.963309 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.963526 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.963618 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.963839 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.963937 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.964178 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.964263 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.964480 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.964565 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.964804 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.964904 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.965151 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.965241 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.965461 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.965546 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.966051 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.966156 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.966358 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.966444 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.966663 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.966754 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.966968 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.967053 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.967274 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.967358 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.967579 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.967662 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.967884 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.967976 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.968196 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.968287 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.968502 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.968587 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.968816 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.968909 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.969146 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.969234 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.969461 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.969556 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.969762 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.969860 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.970071 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.970164 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.970370 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.970466 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.970680 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.970767 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.971010 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.971093 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.971319 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.971413 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.971632 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.971716 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.971939 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.972023 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.972242 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.972334 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.972552 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.972636 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.972855 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.972946 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.973186 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.973289 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.973493 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.973579 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.973800 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.973886 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.974112 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.974204 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.974946 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.975261 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.975589 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.975691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.975913 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.976007 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.976219 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.976305 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.976523 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.976610 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.976832 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.976919 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.977180 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.977269 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.977489 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.977576 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.977809 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.977902 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.978130 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.978215 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.978436 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.978520 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.978738 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.978825 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.979054 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.979140 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.979362 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.979446 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.979664 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.979759 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.979968 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.980055 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.980272 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.980448 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.980578 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.980671 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.980882 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.980969 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.981216 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.981320 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.981531 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.981618 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.981838 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.981933 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.982145 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.982244 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.982447 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.982541 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.982752 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.982837 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.983056 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.983143 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.983356 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.983442 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.983656 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.983741 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.983959 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.984055 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.984266 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.984350 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.984570 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.984654 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.984948 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.985159 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.985257 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.985339 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.985505 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.985598 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.985803 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.985891 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.986110 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.986205 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.986413 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.986499 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.986713 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.986799 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.987010 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.987094 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.987310 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.987405 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.987648 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.987873 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.987959 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.988209 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.988303 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.988527 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.988614 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.988842 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.988926 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.989174 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.989264 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.989486 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.989573 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.989793 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.989878 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.990792 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.991123 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.991298 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.991559 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.991658 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.991884 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.991971 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.992191 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.992283 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.992499 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.992595 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.992809 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.992895 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.993140 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.993241 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.993451 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.993539 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.993758 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.993850 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.994066 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.994160 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.994375 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.994467 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.994678 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.994765 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.995001 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.995151 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.995287 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.995374 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.995602 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.995687 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.995905 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.996210 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.996298 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.996511 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.996596 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.996829 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.996924 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.997166 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.997258 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.997472 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.997559 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.997776 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.997875 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.998081 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.998205 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.998408 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.998492 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.998714 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.998809 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.999040 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.999174 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.999365 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.999479 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:40.999793 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.000012 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.000101 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.000317 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.000404 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.000638 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.000724 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.000942 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.001028 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.001270 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.001358 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.001571 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.001656 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.001868 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.001955 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.002171 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.002256 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.002471 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.002565 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.002767 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.002859 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.003073 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.003171 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.003369 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.003463 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.003675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.003761 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.003972 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.004063 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.004278 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.004374 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.004582 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.004667 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.004882 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.004967 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.005207 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.005377 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.005509 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.005614 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.005851 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.006164 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.006306 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.006468 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.006615 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.006770 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.006953 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.007281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.007377 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.007623 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.007776 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.007927 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.008013 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.008230 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.008317 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.008547 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.008632 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.008847 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.008940 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.009175 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.009266 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.009478 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.009575 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.009781 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.009876 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.010087 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.010174 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.010385 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.010482 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.010686 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.010783 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.010994 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.011080 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.011295 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.011381 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.011596 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.011690 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.011896 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.011981 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.012201 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.012287 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.012500 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.012587 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.012806 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.012890 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.013140 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.013230 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.013438 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.013525 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.013735 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.013819 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.014036 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.014120 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.014338 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.014424 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.014637 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.014722 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.014937 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.015021 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.015234 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.015369 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.015533 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.015619 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.015832 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.015930 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.016132 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.016219 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.016431 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.016517 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.016731 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.016833 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.017031 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.017152 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.017352 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.017439 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.017671 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.017766 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.017977 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.018062 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.018274 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.018372 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.018573 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.018669 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.018877 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.018964 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.019174 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.019259 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.019471 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.019566 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.019776 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.019870 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.020092 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.020177 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.020395 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.020488 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.020699 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.020784 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.021005 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.021131 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.021946 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.022255 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.022346 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.022562 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.022678 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.022883 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.022983 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.023192 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.023286 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.023501 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.023586 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.023821 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.023916 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.024144 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.024237 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.024460 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.024544 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.024764 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.024849 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.025092 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.025181 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.025403 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.025498 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.025703 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.025796 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.026012 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.026105 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.026317 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.026410 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.026624 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.026717 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.026933 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.027020 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.027242 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.027328 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.027550 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.027644 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.027860 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.027945 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.028165 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.028259 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.028469 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.028552 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.028774 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.028858 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.029101 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.029201 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.029403 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.029498 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.029714 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.029800 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.030014 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.030108 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.030322 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.030406 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.030623 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.030707 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.030921 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.031014 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.031223 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.031308 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.031538 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.031644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.031846 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.031939 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.032164 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.032250 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.032481 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.032566 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.032799 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.032886 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.033124 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.033213 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.033434 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.033519 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.033740 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.033828 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.034039 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.034123 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.034342 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.034457 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.034649 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.034776 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.034955 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.035089 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.035262 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.035400 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.035569 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.035704 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.035876 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.036006 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.036182 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.036314 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.036483 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.036636 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.037424 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.037587 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.037815 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.037988 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.038121 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.038247 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.038419 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.038576 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.038722 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.038890 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.039042 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.039195 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.039454 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.039539 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.039763 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.039850 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.040066 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.040151 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.040376 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.040468 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.040774 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.040861 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.041106 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.041195 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.041419 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.041515 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.041723 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.041810 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.042030 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.042122 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.042338 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.042424 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.042648 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.042734 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.042957 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.043041 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.043255 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.043350 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.043586 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.043670 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.043896 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.043989 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.044209 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.044304 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.044514 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.044607 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.044829 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.044914 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.045157 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.045291 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.045466 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.045565 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.045783 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.045868 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.046080 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.046175 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.046381 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.046497 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.046681 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.046804 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.046999 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.047123 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.047299 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.047443 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.047614 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.047746 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.048023 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.048109 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.048330 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.048417 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.048630 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.048715 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.048929 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.049058 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.049274 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.049369 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.049574 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.049661 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.049882 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.049968 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.050191 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.050292 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.050501 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.050600 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.050804 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.050890 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.051107 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.051195 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.051426 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.051512 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.051727 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.051826 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.052045 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.052133 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.052351 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.052466 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.052718 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.053208 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.053317 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.053522 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.053608 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.053845 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.053933 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.054153 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.054248 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.054457 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.054543 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.054761 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.054848 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.055070 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.055158 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.055411 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.055498 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.055716 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.055811 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.056034 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.056121 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.056361 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.056448 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.056665 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.056770 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.056968 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.057075 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.057315 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.057413 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.057617 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.057713 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.057921 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.058008 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.058239 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.058325 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.058539 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.058634 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.058846 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.058933 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.059145 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.059230 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.059446 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.059533 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.059749 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.059837 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.060047 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.060132 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.060346 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.060442 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.060647 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.060735 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.060946 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.061031 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.061272 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.061369 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.061574 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.061661 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.061892 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.061977 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.062194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.062281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.062508 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.062593 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.062813 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.062907 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.063111 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.063206 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.063410 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.063496 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.063709 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.063803 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.064044 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.064131 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.064346 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.064437 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.064658 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.064753 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.064981 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.065095 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.065323 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.065410 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.065626 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.065724 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.065946 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.066034 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.066264 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.066349 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.066578 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.066666 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.066889 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.066982 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.067200 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.067288 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.067500 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.067586 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.067802 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.067888 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.068176 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.068267 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.068653 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.068838 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.068973 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.069176 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.069317 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.069486 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.069631 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.069796 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.069952 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.070099 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.070401 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.070496 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.070704 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.070791 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.071024 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.071123 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.071334 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.071433 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.071655 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.071743 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.071963 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.072049 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.072265 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.072360 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.072569 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.072656 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.072869 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.072957 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.073201 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.073303 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.073513 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.073601 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.073839 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.073925 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.074155 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.074243 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.074474 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.074568 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.074799 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.074885 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.075108 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.075197 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.075420 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.075505 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.075733 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.075819 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.076043 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.076129 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.076353 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.076440 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.076665 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.076760 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.076976 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.077115 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.077313 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.077401 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.077628 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.077722 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.077933 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.078019 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.078240 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.078324 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.078547 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.078641 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.078857 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.078942 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.079167 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.079366 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.079461 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.079691 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.079780 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.080006 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.080091 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.080317 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.080412 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.080625 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.080711 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.080941 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.081051 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.081276 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.081375 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.081585 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.081718 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.081893 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.081981 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.082199 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.082288 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.082505 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.082727 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.082813 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.083045 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.083140 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.083377 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.083464 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.084239 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.084599 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.084684 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.084921 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.085010 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.085265 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.085354 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.085602 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.085703 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.085911 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.085997 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.086219 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.086307 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.086534 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.086629 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.086847 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.086934 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.087153 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.087238 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.087476 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.087572 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.087785 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.087871 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.088089 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.088182 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.088392 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.088485 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.088701 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.088798 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.089009 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.089260 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.089360 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.089604 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.089691 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.089925 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.090019 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.090230 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.090399 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.090549 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.090636 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.091130 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.091215 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.091438 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.091525 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.091752 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.091845 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.092057 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.092143 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.092362 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.092457 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.092678 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.092870 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.092987 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.093216 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.093317 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.093547 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.093634 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.093867 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.093954 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.094188 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.094289 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.094495 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.094581 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.094805 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.094891 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.095108 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.095204 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.095410 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.095503 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.095712 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.095800 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.096021 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.096108 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.096325 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.096412 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.096636 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.096722 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.096941 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.097070 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.097271 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.097358 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.097576 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.097665 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.097880 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.097968 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.098188 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.098309 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.098490 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.098712 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.098801 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.099050 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.099183 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.099913 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.100010 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.100238 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.100635 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.100728 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.100986 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.101090 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.101338 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.101436 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.101644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.101739 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.101949 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.102034 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.102263 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.102369 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.102569 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.102659 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.102885 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.102973 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.103194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.103281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.103495 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.103580 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.103798 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.103892 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.104106 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.104194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.104411 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.104659 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.104747 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.104991 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.105143 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.105320 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.105415 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.105642 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.105731 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.105945 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.106041 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.106245 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.106332 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.106545 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.106631 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.106852 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.106939 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.107153 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.107241 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.107453 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.107548 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.107755 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.107843 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.108056 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.108142 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.108365 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.108450 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.108661 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.108747 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.108965 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.109080 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.109291 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.109379 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.109598 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.109685 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.109899 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.109985 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.110205 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.110299 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.110515 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.110610 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.110822 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.110908 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.111132 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.111227 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.111433 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.111518 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.111751 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.111844 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.112060 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.112156 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.112379 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.112465 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.112687 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.112773 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.112994 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.113123 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.113327 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.113413 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.113635 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.113723 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.113942 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.114169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.114264 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.114498 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.114585 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.114814 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.114927 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.115234 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.115548 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.115634 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.115895 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.115982 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.116203 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.116291 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.116506 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.116595 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.116809 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.116904 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.117156 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.117259 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.117468 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.117556 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.117777 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.117879 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.118085 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.118182 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.118390 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.118475 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.118697 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.118792 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.119001 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.119097 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.119306 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.119393 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.119612 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.119700 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.119918 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.120005 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.120225 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.120312 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.120531 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.120628 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.120832 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.120967 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.121161 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.121249 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.121473 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.121571 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.121779 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.121865 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.122081 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.122186 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.122382 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.122470 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.122689 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.122774 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.122992 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.123087 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.123295 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.123381 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.123596 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.123681 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.123895 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.123991 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.124197 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.124284 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.124494 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.124581 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.124794 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.124889 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.125115 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.125206 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.125424 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.125510 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.125726 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.125822 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.126024 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.126111 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.126330 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.126425 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.126631 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.126727 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.126932 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.127028 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.127232 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.127318 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.127535 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.127665 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.127835 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.127929 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.128162 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.128257 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.128491 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.128577 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.128805 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.128892 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.129151 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.129256 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.129464 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.129551 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.129781 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.129867 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.130083 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.130180 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.130384 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.130470 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.130784 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.131091 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.131189 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.131360 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.131492 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.131693 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.131818 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.132003 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.132138 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.132312 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.132445 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.132621 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.132749 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.132930 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.133076 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.133265 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.133386 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.133575 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.133691 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.133899 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.133999 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.134222 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.134308 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.134527 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.134613 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.134849 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.134937 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.135149 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.135272 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.135448 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.135534 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.135749 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.135836 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.136049 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.136135 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.136348 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.136435 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.136654 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.136750 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.136954 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.137078 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.137281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.137379 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.137582 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.137669 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.137884 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.137971 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.138183 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.138278 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.138499 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.138585 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.138823 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.138909 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.139134 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.139249 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.139443 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.139537 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.139745 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.139838 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.140064 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.140159 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.140370 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.140496 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.140689 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.140775 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.141006 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.141151 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.141350 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.141436 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.141656 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.141743 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.141965 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.142053 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.142269 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.142354 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.142512 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:10:41.142607 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.142872 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.143177 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.143482 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.143787 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.144108 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.144431 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.144731 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.145081 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.145391 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.145706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.146020 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.147364 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.147711 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.148029 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.148344 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.148663 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.148975 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.149328 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.149645 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.149963 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.150289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.150613 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.150924 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.151279 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.151570 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.151917 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.152227 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.152573 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.152897 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.153235 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.153545 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.153850 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:10:41.154091 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:10:41.205047 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO dbcounter [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Registered counter for database nova_api Jul 04 09:10:41.219041 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO dbcounter [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Registered counter for database nova_api Jul 04 09:10:41.318166 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_db.sqlalchemy.engines [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:10:41.324654 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writer thread running {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:10:41.333599 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG oslo_db.sqlalchemy.engines [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:10:41.341208 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writer thread running {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:10:41.381504 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.context [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac196d60-a3f3-44cc-90e3-79ce8ad134b8(cell1) {{(pid=103145) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 09:10:41.385517 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:10:41.387101 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:10:41.387888 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:10:41.390014 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:10:41.392012 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO dbcounter [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Registered counter for database nova_cell0 Jul 04 09:10:41.395861 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO dbcounter [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Registered counter for database nova_cell1 Jul 04 09:10:41.399547 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.context [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac196d60-a3f3-44cc-90e3-79ce8ad134b8(cell1) {{(pid=103146) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 09:10:41.403542 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG oslo_concurrency.lockutils [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:10:41.403761 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_db.sqlalchemy.engines [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:10:41.405153 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG oslo_concurrency.lockutils [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:10:41.405929 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_db.sqlalchemy.engines [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:10:41.406038 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG oslo_concurrency.lockutils [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:10:41.408038 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG oslo_concurrency.lockutils [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:10:41.410070 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO dbcounter [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Registered counter for database nova_cell0 Jul 04 09:10:41.410823 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writer thread running {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:10:41.413575 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writer thread running {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:10:41.414524 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO dbcounter [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Registered counter for database nova_cell1 Jul 04 09:10:41.421734 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG oslo_db.sqlalchemy.engines [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:10:41.425104 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG oslo_db.sqlalchemy.engines [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:10:41.427504 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writer thread running {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:10:41.558529 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO dbcounter [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Registered counter for database nova_cell0 Jul 04 09:10:41.567145 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_db.sqlalchemy.engines [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:10:41.570017 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writer thread running {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:10:41.572007 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writer thread running {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:10:41.579251 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO dbcounter [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Registered counter for database nova_cell0 Jul 04 09:10:41.586528 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG oslo_db.sqlalchemy.engines [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:10:41.591493 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writer thread running {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:10:41.911735 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: WARNING keystonemiddleware.auth_token [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:10:41.919042 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: WARNING keystonemiddleware.auth_token [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:10:41.922335 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: WARNING keystonemiddleware.auth_token [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:10:41.930662 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: WARNING keystonemiddleware.auth_token [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:10:42.261329 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: WARNING keystonemiddleware.auth_token [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:10:42.267256 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: WARNING keystonemiddleware.auth_token [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:10:42.272611 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56421a2b49c0 pid: 103145 (default app) Jul 04 09:10:42.274672 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:10:42.275856 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] 10.222.0.71 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001707 Jul 04 09:10:42.276274 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 788 bytes} [Mon Jul 4 09:10:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:10:42.288586 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: WARNING keystonemiddleware.auth_token [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:10:42.294523 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: WARNING keystonemiddleware.auth_token [None req-16bbe43f-217d-45d7-8d60-9ed14a7d3c57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:10:42.299756 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56421a2b49c0 pid: 103146 (default app) Jul 04 09:11:57.663586 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:11:57.664523 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 04 09:11:57.664919 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 2/2] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:11:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:11:57.677220 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_api:SELECT=3 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:57.678290 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_cell0:SELECT=3 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:57.679139 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_cell1:SELECT=3 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:57.679840 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_cell0:SELECT=3 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:11:58.108036 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-bc975ed5-567e-4df6-9008-8e86323ca02e admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:11:58.138140 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-bc975ed5-567e-4df6-9008-8e86323ca02e admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.466335 Jul 04 09:11:58.138771 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 1/3] 10.222.0.71 () {60 vars in 1291 bytes} [Mon Jul 4 09:11:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:12:00.258213 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:00.259209 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-b877cf7b-1805-480e-a90a-1b9638eacf81 None None] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 04 09:12:00.259614 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 3/4] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:00.319976 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-86efc0da-33c6-4072-a515-abcb1f0a3b0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "id": "c1", "swap": 0, "disk": 1, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:00.339729 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:12:00.339729 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: warnings.warn(msg) Jul 04 09:12:00.372231 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-86efc0da-33c6-4072-a515-abcb1f0a3b0c admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106182 Jul 04 09:12:00.373428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 2/5] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 4 09:12:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 09:12:00.603043 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-b711463b-7679-4585-810b-443f5c05c126 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:00.605395 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:12:00.605395 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: warnings.warn(msg) Jul 04 09:12:00.608033 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writing DB stats nova_api:SELECT=3 {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:00.608827 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writing DB stats nova_cell1:SELECT=3 {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:00.609704 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writing DB stats nova_cell0:SELECT=3 {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:00.610395 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:00.671125 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-b711463b-7679-4585-810b-443f5c05c126 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287667 Jul 04 09:12:00.672272 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 4/6] 10.222.0.71 () {64 vars in 1335 bytes} [Mon Jul 4 09:12:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:12:02.783866 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-86efc0da-33c6-4072-a515-abcb1f0a3b0c admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:02.784891 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-86efc0da-33c6-4072-a515-abcb1f0a3b0c admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 04 09:12:02.785342 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 3/7] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:02.893385 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-55ae185a-54c4-42dc-87c3-56f791545a37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:02.911348 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:12:02.911348 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: warnings.warn(msg) Jul 04 09:12:02.930352 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-55ae185a-54c4-42dc-87c3-56f791545a37 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139015 Jul 04 09:12:02.930862 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 5/8] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 4 09:12:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 09:12:02.942880 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c7d70b62-e00a-4981-b668-58b3c9b2b30f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:02.944367 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:12:02.944367 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: warnings.warn(msg) Jul 04 09:12:02.981233 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c7d70b62-e00a-4981-b668-58b3c9b2b30f admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042031 Jul 04 09:12:02.981827 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 4/9] 10.222.0.71 () {64 vars in 1335 bytes} [Mon Jul 4 09:12:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:12:05.077072 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-55ae185a-54c4-42dc-87c3-56f791545a37 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:05.078097 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-55ae185a-54c4-42dc-87c3-56f791545a37 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 04 09:12:05.078513 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 6/10] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:05.141872 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-5c48dd3e-daf4-4190-a35c-6f71ff41dc69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "vcpus": 1, "name": "ds1G"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:05.162292 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-5c48dd3e-daf4-4190-a35c-6f71ff41dc69 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077820 Jul 04 09:12:05.163062 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 5/11] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 4 09:12:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:05.175442 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-d6ec9184-9360-4f61-8afd-0d6696a4e661 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:05.200456 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-d6ec9184-9360-4f61-8afd-0d6696a4e661 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028837 Jul 04 09:12:05.201487 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 7/12] 10.222.0.71 () {64 vars in 1335 bytes} [Mon Jul 4 09:12:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:12:07.351175 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-5c48dd3e-daf4-4190-a35c-6f71ff41dc69 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:07.352311 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-5c48dd3e-daf4-4190-a35c-6f71ff41dc69 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jul 04 09:12:07.352740 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 6/13] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:07.411175 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-786cd2e7-ed49-401d-88bf-57f12c934f53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "name": "ds2G", "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:07.428491 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-786cd2e7-ed49-401d-88bf-57f12c934f53 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069994 Jul 04 09:12:07.429067 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 8/14] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 4 09:12:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:07.440697 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-6951ba37-9e8b-4ad8-8167-10b2ed688247 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:07.463381 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-6951ba37-9e8b-4ad8-8167-10b2ed688247 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026381 Jul 04 09:12:07.465241 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 7/15] 10.222.0.71 () {64 vars in 1335 bytes} [Mon Jul 4 09:12:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:12:09.546099 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-786cd2e7-ed49-401d-88bf-57f12c934f53 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:09.547098 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-786cd2e7-ed49-401d-88bf-57f12c934f53 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 04 09:12:09.547496 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 9/16] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:09.605684 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c6daa8c3-6d9c-479e-9b22-10152e150681 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:09.623689 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c6daa8c3-6d9c-479e-9b22-10152e150681 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069756 Jul 04 09:12:09.624279 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 8/17] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 4 09:12:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 09:12:09.636551 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-7750c0a0-2419-42fc-894c-0113fad75005 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:09.659999 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-7750c0a0-2419-42fc-894c-0113fad75005 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027077 Jul 04 09:12:09.660505 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 10/18] 10.222.0.71 () {64 vars in 1335 bytes} [Mon Jul 4 09:12:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:12:11.802649 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c6daa8c3-6d9c-479e-9b22-10152e150681 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:11.804321 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c6daa8c3-6d9c-479e-9b22-10152e150681 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002617 Jul 04 09:12:11.804720 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 9/19] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:11.871009 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-f34e7aa1-caf6-4bd3-b78d-aaf238c3bff4 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:11.894596 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-f34e7aa1-caf6-4bd3-b78d-aaf238c3bff4 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084024 Jul 04 09:12:11.895326 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 11/20] 10.222.0.71 () {60 vars in 1291 bytes} [Mon Jul 4 09:12:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:12:14.030750 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c6daa8c3-6d9c-479e-9b22-10152e150681 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:14.031911 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c6daa8c3-6d9c-479e-9b22-10152e150681 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001771 Jul 04 09:12:14.032423 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 10/21] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:14.114351 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-860de595-37bf-4882-b237-1ceeb756c773 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "os-flavor-access:is_public": true}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:14.139210 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-860de595-37bf-4882-b237-1ceeb756c773 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.100234 Jul 04 09:12:14.140031 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 12/22] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 4 09:12:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:14.154427 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-bff77662-70ea-4ff3-8d5a-2b5de3babd6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:14.182264 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-bff77662-70ea-4ff3-8d5a-2b5de3babd6a admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032710 Jul 04 09:12:14.182898 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 11/23] 10.222.0.71 () {64 vars in 1332 bytes} [Mon Jul 4 09:12:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:12:16.337295 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-860de595-37bf-4882-b237-1ceeb756c773 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:16.338271 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-860de595-37bf-4882-b237-1ceeb756c773 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jul 04 09:12:16.338678 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 13/24] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:12:16.410959 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-422777e7-ae7b-4730-bb33-f5487ae0af91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:16.429704 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-422777e7-ae7b-4730-bb33-f5487ae0af91 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084824 Jul 04 09:12:16.430294 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 12/25] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 4 09:12:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 09:12:16.442545 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-2d9e101e-3864-492b-9c67-27a784498aa2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:16.468197 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-2d9e101e-3864-492b-9c67-27a784498aa2 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029108 Jul 04 09:12:16.468757 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 14/26] 10.222.0.71 () {64 vars in 1332 bytes} [Mon Jul 4 09:12:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:12:19.088626 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-422777e7-ae7b-4730-bb33-f5487ae0af91 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:19.089970 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-422777e7-ae7b-4730-bb33-f5487ae0af91 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001919 Jul 04 09:12:19.090509 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 13/27] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:19.151259 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-9cda684e-804e-44c8-8cd2-50caa92fda86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "swap": 0, "disk": 40}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:19.168755 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-9cda684e-804e-44c8-8cd2-50caa92fda86 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070997 Jul 04 09:12:19.169340 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 15/28] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 4 09:12:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:19.183785 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-6e91c6d8-c3f8-42d6-a654-73639d79a48d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:19.206145 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-6e91c6d8-c3f8-42d6-a654-73639d79a48d admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026124 Jul 04 09:12:19.206714 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 14/29] 10.222.0.71 () {64 vars in 1332 bytes} [Mon Jul 4 09:12:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:12:21.267264 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-9cda684e-804e-44c8-8cd2-50caa92fda86 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:21.268347 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-9cda684e-804e-44c8-8cd2-50caa92fda86 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 04 09:12:21.268758 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 16/30] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:21.327132 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-24a3b209-f61e-4c1e-a495-fe2e63ff8115 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:21.345866 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-24a3b209-f61e-4c1e-a495-fe2e63ff8115 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070567 Jul 04 09:12:21.346403 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 15/31] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 4 09:12:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 09:12:21.358601 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-c783593b-7995-42ae-a79a-5098c8429f18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:21.381169 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-c783593b-7995-42ae-a79a-5098c8429f18 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026280 Jul 04 09:12:21.382042 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 17/32] 10.222.0.71 () {64 vars in 1332 bytes} [Mon Jul 4 09:12:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:12:23.498802 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-24a3b209-f61e-4c1e-a495-fe2e63ff8115 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:23.500445 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-24a3b209-f61e-4c1e-a495-fe2e63ff8115 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Jul 04 09:12:23.501020 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 16/33] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:23.590766 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-06842641-925d-4efa-a173-5bf5f7fb8d7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "disk": 160}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:23.611344 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-06842641-925d-4efa-a173-5bf5f7fb8d7f admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.096060 Jul 04 09:12:23.611899 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 18/34] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 4 09:12:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:23.624204 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-f7178394-500e-4a12-ad5e-1e5647a4d341 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:23.650615 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-f7178394-500e-4a12-ad5e-1e5647a4d341 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029964 Jul 04 09:12:23.651105 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 17/35] 10.222.0.71 () {64 vars in 1332 bytes} [Mon Jul 4 09:12:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:12:47.978838 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-06842641-925d-4efa-a173-5bf5f7fb8d7f admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:47.979782 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-06842641-925d-4efa-a173-5bf5f7fb8d7f admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 04 09:12:47.980184 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 19/36] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:12:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:47.990803 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:48.039471 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-80f1df2b-9edb-49bd-b266-fb69b985d043 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:48.056104 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-80f1df2b-9edb-49bd-b266-fb69b985d043 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070024 Jul 04 09:12:48.056645 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 18/37] 10.222.0.71 () {60 vars in 1291 bytes} [Mon Jul 4 09:12:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:12:48.977956 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-06842641-925d-4efa-a173-5bf5f7fb8d7f admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:48.978943 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-06842641-925d-4efa-a173-5bf5f7fb8d7f admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 04 09:12:48.979478 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 20/38] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:49.173440 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-a11f530e-073c-4259-a7f9-9ee83e05e956 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:49.180190 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.wsgi [None req-a11f530e-073c-4259-a7f9-9ee83e05e956 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-a11f530e-073c-4259-a7f9-9ee83e05e956 admin admin] Request method failure captured: Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Accept: application/json Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Accept-Encoding: gzip, deflate Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Connection: keep-alive Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Content-Length: 0 Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Host: 10.222.0.71 Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Openstack-Api-Version: compute 2.90 Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Openstack-System-Scope: None Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: User-Agent: python-novaclient Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Auth-Token: gAAAAABiwq8Q6RF6VnK4hQGYlaxOdhsQZF7xzVWYm9GqqIuuy2cGpQtswbmfd6wTIduWu1yYQ09hNWjiMyIGrT2sS1JIRgZnn55aRQXwVuwBXDem2AFCe_c_8hPfQiILITAZFuTfLeFDUAdPYIEuG-MJo95S_75Rm5bjNWl5a_EjtP1rSzASD8w Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Domain-Id: None Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Domain-Name: None Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Identity-Status: Confirmed Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Is-Admin-Project: True Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Domain-Id: default Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Domain-Name: Default Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Name: admin Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Role: admin,member,reader Jul 04 09:12:49.183428 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Roles: admin,member,reader Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a34f9b2c1cbf4bceb4067648553a5416", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Tenant: admin Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Tenant-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Tenant-Name: admin Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User: admin Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Domain-Id: default Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Domain-Name: Default Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Id: fa43c0e65110476d9e52a93b45c1a988 Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Name: admin Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: method: > Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: exception: Flavor 42 could not be found. Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: action_args: {'id': '42'} Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:12:49.185169 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:49.186289 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:49.187706 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-a11f530e-073c-4259-a7f9-9ee83e05e956 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:12:49.188961 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-a11f530e-073c-4259-a7f9-9ee83e05e956 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063051 Jul 04 09:12:49.188961 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 19/39] 10.222.0.71 () {60 vars in 1190 bytes} [Mon Jul 4 09:12:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 09:12:49.195187 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-5f8ee505-4eb3-4d43-adcc-c57789fbb10a admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:49.198033 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:12:49.218396 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-5f8ee505-4eb3-4d43-adcc-c57789fbb10a admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027494 Jul 04 09:12:49.219205 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 21/40] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 4 09:12:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:12:49.229311 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-e7493ad6-5ffe-4e58-9cc2-e53485dc1bac admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:49.250631 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-e7493ad6-5ffe-4e58-9cc2-e53485dc1bac admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024902 Jul 04 09:12:49.251166 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 20/41] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 4 09:12:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:12:49.262047 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-587e8861-55f5-4759-b315-96df5e40a63f admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:49.268064 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.wsgi [None req-587e8861-55f5-4759-b315-96df5e40a63f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-587e8861-55f5-4759-b315-96df5e40a63f admin admin] Request method failure captured: Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Accept: application/json Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Accept-Encoding: gzip, deflate Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Connection: keep-alive Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Content-Length: 0 Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Host: 10.222.0.71 Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Openstack-Api-Version: compute 2.90 Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Openstack-System-Scope: None Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: User-Agent: python-novaclient Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Auth-Token: gAAAAABiwq8Q6RF6VnK4hQGYlaxOdhsQZF7xzVWYm9GqqIuuy2cGpQtswbmfd6wTIduWu1yYQ09hNWjiMyIGrT2sS1JIRgZnn55aRQXwVuwBXDem2AFCe_c_8hPfQiILITAZFuTfLeFDUAdPYIEuG-MJo95S_75Rm5bjNWl5a_EjtP1rSzASD8w Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Domain-Id: None Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Domain-Name: None Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Identity-Status: Confirmed Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Is-Admin-Project: True Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Domain-Id: default Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Domain-Name: Default Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Name: admin Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Role: admin,member,reader Jul 04 09:12:49.272301 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Roles: admin,member,reader Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a34f9b2c1cbf4bceb4067648553a5416", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Tenant: admin Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Tenant-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Tenant-Name: admin Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User: admin Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Domain-Id: default Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Domain-Name: Default Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Id: fa43c0e65110476d9e52a93b45c1a988 Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Name: admin Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: method: > Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: exception: Flavor 42 could not be found. Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: action_args: {'id': '42'} Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:12:49.273691 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:49.274473 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:49.275644 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-587e8861-55f5-4759-b315-96df5e40a63f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:12:49.276681 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-587e8861-55f5-4759-b315-96df5e40a63f admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016112 Jul 04 09:12:49.276681 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 22/42] 10.222.0.71 () {60 vars in 1190 bytes} [Mon Jul 4 09:12:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 04 09:12:50.088161 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-e7493ad6-5ffe-4e58-9cc2-e53485dc1bac admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:50.089210 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-e7493ad6-5ffe-4e58-9cc2-e53485dc1bac admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 04 09:12:50.089610 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 21/43] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:50.278841 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-14920850-1d90-4cd5-a4aa-7543977b03cc admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:50.284648 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.wsgi [None req-14920850-1d90-4cd5-a4aa-7543977b03cc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-14920850-1d90-4cd5-a4aa-7543977b03cc admin admin] Request method failure captured: Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Accept: application/json Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Accept-Encoding: gzip, deflate Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Connection: keep-alive Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Content-Length: 0 Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Host: 10.222.0.71 Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Openstack-Api-Version: compute 2.90 Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Openstack-System-Scope: None Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: User-Agent: python-novaclient Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Auth-Token: gAAAAABiwq8SSNXknfUK4C8X56sKlG1TmfntAD0IQBt2sf2bAKieyFapVO-tPxUDVJ5LFQfDASjm_SC8d95JNA6jFhSsSZLhEqs67PbNhCac5blpabwRV395jgqlem8VBVsHHgHxScbKuDVoWxxSJ_csvWapJpR7wAkMEN894W_eDa85M6efuy4 Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Domain-Id: None Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Domain-Name: None Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Identity-Status: Confirmed Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Is-Admin-Project: True Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Domain-Id: default Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Domain-Name: Default Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Name: admin Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Role: admin,member,reader Jul 04 09:12:50.286194 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Roles: admin,member,reader Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a34f9b2c1cbf4bceb4067648553a5416", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Tenant: admin Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Tenant-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Tenant-Name: admin Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User: admin Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Domain-Id: default Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Domain-Name: Default Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Id: fa43c0e65110476d9e52a93b45c1a988 Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Name: admin Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: method: > Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: exception: Flavor 84 could not be found. Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: action_args: {'id': '84'} Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:12:50.288824 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:50.289944 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:50.291252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-14920850-1d90-4cd5-a4aa-7543977b03cc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:12:50.292498 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-14920850-1d90-4cd5-a4aa-7543977b03cc admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060506 Jul 04 09:12:50.292498 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 23/44] 10.222.0.71 () {60 vars in 1190 bytes} [Mon Jul 4 09:12:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 09:12:50.297807 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-72926769-2d6b-4bb3-b4aa-7f6c6e58739f admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:50.311421 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-72926769-2d6b-4bb3-b4aa-7f6c6e58739f admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017266 Jul 04 09:12:50.311936 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 22/45] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 4 09:12:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:12:50.321275 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-1e0e87e0-39c5-4ea2-8c26-a7ef9155b134 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:50.335358 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-1e0e87e0-39c5-4ea2-8c26-a7ef9155b134 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017757 Jul 04 09:12:50.335879 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 24/46] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 4 09:12:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:12:50.345496 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-6ab0f11b-d47d-40d1-884e-936c446dbff5 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:50.351458 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.wsgi [None req-6ab0f11b-d47d-40d1-884e-936c446dbff5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-6ab0f11b-d47d-40d1-884e-936c446dbff5 admin admin] Request method failure captured: Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Accept: application/json Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Accept-Encoding: gzip, deflate Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Connection: keep-alive Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Content-Length: 0 Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Host: 10.222.0.71 Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Openstack-Api-Version: compute 2.90 Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Openstack-System-Scope: None Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: User-Agent: python-novaclient Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Auth-Token: gAAAAABiwq8SSNXknfUK4C8X56sKlG1TmfntAD0IQBt2sf2bAKieyFapVO-tPxUDVJ5LFQfDASjm_SC8d95JNA6jFhSsSZLhEqs67PbNhCac5blpabwRV395jgqlem8VBVsHHgHxScbKuDVoWxxSJ_csvWapJpR7wAkMEN894W_eDa85M6efuy4 Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Domain-Id: None Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Domain-Name: None Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Identity-Status: Confirmed Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Is-Admin-Project: True Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Domain-Id: default Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Domain-Name: Default Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Name: admin Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Role: admin,member,reader Jul 04 09:12:50.352973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Roles: admin,member,reader Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a34f9b2c1cbf4bceb4067648553a5416", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Tenant: admin Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Tenant-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Tenant-Name: admin Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User: admin Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Domain-Id: default Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Domain-Name: Default Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Id: fa43c0e65110476d9e52a93b45c1a988 Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Name: admin Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: method: > Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: exception: Flavor 84 could not be found. Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: action_args: {'id': '84'} Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:12:50.354605 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:50.355660 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:50.356996 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-6ab0f11b-d47d-40d1-884e-936c446dbff5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:12:50.358396 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-6ab0f11b-d47d-40d1-884e-936c446dbff5 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012903 Jul 04 09:12:50.358396 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 23/47] 10.222.0.71 () {60 vars in 1190 bytes} [Mon Jul 4 09:12:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 09:12:51.193108 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-1e0e87e0-39c5-4ea2-8c26-a7ef9155b134 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:51.194111 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-1e0e87e0-39c5-4ea2-8c26-a7ef9155b134 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 04 09:12:51.194511 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 25/48] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:51.384545 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-bed897b1-d506-4b28-8144-9c425a0db079 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:51.390400 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.wsgi [None req-bed897b1-d506-4b28-8144-9c425a0db079 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-bed897b1-d506-4b28-8144-9c425a0db079 admin admin] Request method failure captured: Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Accept: application/json Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Accept-Encoding: gzip, deflate Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Connection: keep-alive Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Content-Length: 0 Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Host: 10.222.0.71 Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Openstack-Api-Version: compute 2.90 Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Openstack-System-Scope: None Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: User-Agent: python-novaclient Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Auth-Token: gAAAAABiwq8T2SgC6bsfNcDb-_w-JAYXDScWlh1wyzOjSBL5DJNhMCb1hZyM1BgCrC1KnjSPrMqhU1eNRJkzoehNw0VXtOzt8grTMbd14MKMMBnfoTpKii4pVV3S8LzBanIRYhDsnLDGOaRgCV2MZFWQO2fXjSPPC1dm4-qiub1eXU21XCAFbRQ Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Domain-Id: None Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Domain-Name: None Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Identity-Status: Confirmed Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Is-Admin-Project: True Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Domain-Id: default Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Domain-Name: Default Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Project-Name: admin Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Role: admin,member,reader Jul 04 09:12:51.391939 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Roles: admin,member,reader Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a34f9b2c1cbf4bceb4067648553a5416", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Tenant: admin Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Tenant-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-Tenant-Name: admin Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User: admin Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Domain-Id: default Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Domain-Name: Default Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Id: fa43c0e65110476d9e52a93b45c1a988 Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: X-User-Name: admin Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: method: > Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: exception: Flavor 451 could not be found. Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: action_args: {'id': '451'} Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:12:51.393281 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:51.394113 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jul 04 09:12:51.395705 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-bed897b1-d506-4b28-8144-9c425a0db079 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:12:51.396841 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-bed897b1-d506-4b28-8144-9c425a0db079 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060833 Jul 04 09:12:51.396841 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 24/49] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 4 09:12:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 09:12:51.403203 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-2913cc69-8c6d-4873-b322-fdd0fa07ac66 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:51.417366 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-2913cc69-8c6d-4873-b322-fdd0fa07ac66 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017518 Jul 04 09:12:51.417892 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 26/50] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 4 09:12:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:12:51.427083 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:51.441240 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017601 Jul 04 09:12:51.441770 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 25/51] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 4 09:12:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:12:51.450931 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-96ec791c-7db5-45d6-a0e6-6634710efa38 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:51.456247 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.wsgi [None req-96ec791c-7db5-45d6-a0e6-6634710efa38 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-96ec791c-7db5-45d6-a0e6-6634710efa38 admin admin] Request method failure captured: Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Accept: application/json Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Accept-Encoding: gzip, deflate Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Connection: keep-alive Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Content-Length: 0 Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Host: 10.222.0.71 Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Openstack-Api-Version: compute 2.90 Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Openstack-System-Scope: None Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: User-Agent: python-novaclient Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Auth-Token: gAAAAABiwq8T2SgC6bsfNcDb-_w-JAYXDScWlh1wyzOjSBL5DJNhMCb1hZyM1BgCrC1KnjSPrMqhU1eNRJkzoehNw0VXtOzt8grTMbd14MKMMBnfoTpKii4pVV3S8LzBanIRYhDsnLDGOaRgCV2MZFWQO2fXjSPPC1dm4-qiub1eXU21XCAFbRQ Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Domain-Id: None Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Domain-Name: None Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Identity-Status: Confirmed Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Is-Admin-Project: True Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Domain-Id: default Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Domain-Name: Default Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Project-Name: admin Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Role: admin,member,reader Jul 04 09:12:51.457765 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Roles: admin,member,reader Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a34f9b2c1cbf4bceb4067648553a5416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a34f9b2c1cbf4bceb4067648553a5416", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Tenant: admin Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Tenant-Id: a34f9b2c1cbf4bceb4067648553a5416 Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-Tenant-Name: admin Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User: admin Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Domain-Id: default Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Domain-Name: Default Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Id: fa43c0e65110476d9e52a93b45c1a988 Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: X-User-Name: admin Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: method: > Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: exception: Flavor 451 could not be found. Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: action_args: {'id': '451'} Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:12:51.459297 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:51.460253 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: ERROR nova.api.openstack.wsgi Jul 04 09:12:51.461675 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-96ec791c-7db5-45d6-a0e6-6634710efa38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:12:51.463005 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-96ec791c-7db5-45d6-a0e6-6634710efa38 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011902 Jul 04 09:12:51.463005 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 27/52] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 4 09:12:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 04 09:12:52.272937 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:52.273973 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 04 09:12:52.274365 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 26/53] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:52.465223 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-26f2bb15-5675-4398-b981-119e5a82b49b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:52.484143 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-26f2bb15-5675-4398-b981-119e5a82b49b admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072140 Jul 04 09:12:52.484681 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 28/54] 10.222.0.71 () {64 vars in 1235 bytes} [Mon Jul 4 09:12:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:53.303375 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:53.304419 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 04 09:12:53.304816 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 27/55] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:53.496279 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-eae34e83-05f3-4410-abce-5e17ff20fff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:53.513509 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-eae34e83-05f3-4410-abce-5e17ff20fff8 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069279 Jul 04 09:12:53.513989 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 29/56] 10.222.0.71 () {64 vars in 1235 bytes} [Mon Jul 4 09:12:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:54.340014 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:54.341059 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 04 09:12:54.341463 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 28/57] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:12:54.534593 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-7b6491eb-01d3-4e01-aca9-6504dd50befe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:54.553729 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-7b6491eb-01d3-4e01-aca9-6504dd50befe admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071457 Jul 04 09:12:54.554287 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 30/58] 10.222.0.71 () {64 vars in 1235 bytes} [Mon Jul 4 09:12:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:55.375761 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:55.376777 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 04 09:12:55.377209 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 29/59] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:55.570786 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-2c9d969d-0aec-4ab2-8771-83417d829aea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:12:55.589838 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-2c9d969d-0aec-4ab2-8771-83417d829aea admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071407 Jul 04 09:12:55.590308 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 31/60] 10.222.0.71 () {64 vars in 1235 bytes} [Mon Jul 4 09:12:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:12:56.413359 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:56.414380 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 04 09:12:56.414781 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 30/61] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:12:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:12:56.635739 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-209fc59e-5192-4703-a010-1a035f797521 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:12:56.656567 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-209fc59e-5192-4703-a010-1a035f797521 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075725 Jul 04 09:12:56.657135 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 32/62] 10.222.0.71 () {60 vars in 1202 bytes} [Mon Jul 4 09:12:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:13:43.528934 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:13:43.529980 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-38710fa5-b4df-42a0-82c1-e7b498046346 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 04 09:13:43.530386 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 31/63] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 4 09:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:13:43.541595 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:43.589724 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-62490d84-bd9d-4a22-9144-e1ae0471feb5 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:13:43.608620 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-62490d84-bd9d-4a22-9144-e1ae0471feb5 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071530 Jul 04 09:13:43.609180 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 33/64] 10.222.0.71 () {60 vars in 1291 bytes} [Mon Jul 4 09:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:13:43.632037 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-68b7d5d5-d9e4-48f1-a64e-230756786a3c admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:13:43.635618 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_api:SELECT=14 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:13:43.641561 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-68b7d5d5-d9e4-48f1-a64e-230756786a3c admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013638 Jul 04 09:13:43.642108 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 32/65] 10.222.0.71 () {60 vars in 1282 bytes} [Mon Jul 4 09:13:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:13:43.654268 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-5eeaf297-978a-4d3c-bbf0-85a6e3eea95a admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:13:43.662332 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-5eeaf297-978a-4d3c-bbf0-85a6e3eea95a admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011713 Jul 04 09:13:43.662853 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 34/66] 10.222.0.71 () {60 vars in 1285 bytes} [Mon Jul 4 09:13:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:13:43.674282 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-f78f0d25-6060-45b8-8744-d5b9583ae95e admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:13:43.682755 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-f78f0d25-6060-45b8-8744-d5b9583ae95e admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012047 Jul 04 09:13:43.683309 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 33/67] 10.222.0.71 () {60 vars in 1285 bytes} [Mon Jul 4 09:13:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:13:43.695530 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-db73c995-7562-49e0-87b5-ddc7191199c8 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:13:43.703224 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-db73c995-7562-49e0-87b5-ddc7191199c8 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011426 Jul 04 09:13:43.703745 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 35/68] 10.222.0.71 () {60 vars in 1282 bytes} [Mon Jul 4 09:13:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:17:02.221156 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-f78f0d25-6060-45b8-8744-d5b9583ae95e admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:02.222174 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-f78f0d25-6060-45b8-8744-d5b9583ae95e admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 04 09:17:02.222572 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 34/69] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:17:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:02.378763 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writing DB stats nova_api:SELECT=6 {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:02.493280 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-6f231778-fcaf-4041-9fea-d0307c985874 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:02.494485 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:17:02.494485 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: warnings.warn(msg) Jul 04 09:17:02.495892 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-6f231778-fcaf-4041-9fea-d0307c985874 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:02.496252 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-6f231778-fcaf-4041-9fea-d0307c985874 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.497088 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-6f231778-fcaf-4041-9fea-d0307c985874 admin admin] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:02.497525 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-6f231778-fcaf-4041-9fea-d0307c985874 admin admin] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:02.533013 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-6f231778-fcaf-4041-9fea-d0307c985874 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155632 Jul 04 09:17:02.533609 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 36/70] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 4 09:17:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:17:03.379632 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-f78f0d25-6060-45b8-8744-d5b9583ae95e admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:03.380756 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-f78f0d25-6060-45b8-8744-d5b9583ae95e admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 04 09:17:03.381215 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 35/71] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:03.577071 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-341f173c-31bf-45e3-b403-9551c09657a9 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:03.578270 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:17:03.578270 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: warnings.warn(msg) Jul 04 09:17:03.579566 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-341f173c-31bf-45e3-b403-9551c09657a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.580004 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-341f173c-31bf-45e3-b403-9551c09657a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:03.580775 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-341f173c-31bf-45e3-b403-9551c09657a9 admin admin] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:03.581241 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-341f173c-31bf-45e3-b403-9551c09657a9 admin admin] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:03.600764 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-341f173c-31bf-45e3-b403-9551c09657a9 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076921 Jul 04 09:17:03.601427 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 37/72] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 4 09:17:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:17:14.855378 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-f78f0d25-6060-45b8-8744-d5b9583ae95e admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:14.856382 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-f78f0d25-6060-45b8-8744-d5b9583ae95e admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001922 Jul 04 09:17:14.856792 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 36/73] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:17:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:15.002931 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writing DB stats nova_cell0:SELECT=4 {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:15.003638 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writing DB stats nova_cell1:SELECT=4 {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:15.004231 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG dbcounter [-] [103145] Writing DB stats nova_api:SELECT=8 {{(pid=103145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:17:15.052979 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-e01c9ee2-09fa-48d6-9718-e6b674d3d077 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:15.054152 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:17:15.054152 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: warnings.warn(msg) Jul 04 09:17:15.055384 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-e01c9ee2-09fa-48d6-9718-e6b674d3d077 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:15.055818 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-e01c9ee2-09fa-48d6-9718-e6b674d3d077 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:15.056589 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-e01c9ee2-09fa-48d6-9718-e6b674d3d077 admin admin] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:15.057013 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-e01c9ee2-09fa-48d6-9718-e6b674d3d077 admin admin] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:15.081407 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-e01c9ee2-09fa-48d6-9718-e6b674d3d077 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082771 Jul 04 09:17:15.081892 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 38/74] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 4 09:17:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:17:15.909361 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-f78f0d25-6060-45b8-8744-d5b9583ae95e admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:15.910377 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-f78f0d25-6060-45b8-8744-d5b9583ae95e admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 04 09:17:15.910779 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 37/75] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 4 09:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:17:16.103192 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG nova.api.openstack.wsgi [None req-e6ccccf5-9af8-4000-811f-cfbc80df8c37 admin admin] Calling method '>' {{(pid=103145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:17:16.104929 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 09:17:16.104929 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: warnings.warn(msg) Jul 04 09:17:16.106164 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-e6ccccf5-9af8-4000-811f-cfbc80df8c37 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:16.106601 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-e6ccccf5-9af8-4000-811f-cfbc80df8c37 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:16.107400 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-e6ccccf5-9af8-4000-811f-cfbc80df8c37 admin admin] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:17:16.107828 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: DEBUG oslo_concurrency.lockutils [None req-e6ccccf5-9af8-4000-811f-cfbc80df8c37 admin admin] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:17:16.129167 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: INFO nova.api.openstack.requestlog [None req-e6ccccf5-9af8-4000-811f-cfbc80df8c37 admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077722 Jul 04 09:17:16.129653 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: [pid: 103145|app: 0|req: 39/76] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 4 09:17:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:18:11.491031 dv-cinder-844563-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 04 09:18:11.491757 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: Mon Jul 4 09:18:11 2022 - graceful shutdown triggered... Jul 04 09:18:11.492236 dv-cinder-844563-4-iscsi devstack@n-api.service[103146]: Gracefully killing worker 2 (pid: 103146)... Jul 04 09:18:11.492599 dv-cinder-844563-4-iscsi devstack@n-api.service[103145]: Gracefully killing worker 1 (pid: 103145)... Jul 04 09:18:12.492906 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: worker 1 buried after 1 seconds Jul 04 09:18:12.493396 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: worker 2 buried after 1 seconds Jul 04 09:18:12.493396 dv-cinder-844563-4-iscsi devstack@n-api.service[103144]: goodbye to uWSGI. Jul 04 09:18:12.494573 dv-cinder-844563-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 04 09:18:12.495130 dv-cinder-844563-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 04 09:18:12.497947 dv-cinder-844563-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 09:18:12.506941 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 09:18:12 2022] *** Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: nodename: dv-cinder-844563-4-iscsi Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: machine: x86_64 Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: clock source: unix Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: pcre jit disabled Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: detected number of CPU cores: 4 Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: current working directory: / Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: detected binary path: /usr/bin/uwsgi-core Jul 04 09:18:12.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: your processes number limit is 47680 Jul 04 09:18:12.510187 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: your memory page size is 4096 bytes Jul 04 09:18:12.510187 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: detected max file descriptor number: 2048 Jul 04 09:18:12.510187 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: lock engine: pthread robust mutexes Jul 04 09:18:12.510187 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: thunder lock: enabled Jul 04 09:18:12.510187 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 09:18:12.510187 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 09:18:12.556033 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: Python main interpreter initialized at 0x55677f7fa9c0 Jul 04 09:18:12.556033 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: python threads support enabled Jul 04 09:18:12.556033 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: your server socket listen backlog is limited to 100 connections Jul 04 09:18:12.556033 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: your mercy for graceful operations on workers is 90 seconds Jul 04 09:18:12.556498 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 09:18:12.556498 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: *** Operational MODE: preforking *** Jul 04 09:18:12.557292 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: *** uWSGI is running in multiple interpreter mode *** Jul 04 09:18:12.557292 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: spawned uWSGI master process (pid: 117648) Jul 04 09:18:12.557418 dv-cinder-844563-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 09:18:12.557983 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: spawned uWSGI worker 1 (pid: 117664, cores: 1) Jul 04 09:18:12.558336 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: spawned uWSGI worker 2 (pid: 117665, cores: 1) Jul 04 09:18:12.558477 dv-cinder-844563-4-iscsi devstack@n-api.service[117648]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 09:18:13.217111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 09:18:13.229786 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 09:18:14.423144 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:18:14.423144 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: from cryptography.utils import int_from_bytes Jul 04 09:18:14.423804 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:18:14.423804 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: from cryptography.utils import int_from_bytes Jul 04 09:18:14.447798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:18:14.447798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: from cryptography.utils import int_from_bytes Jul 04 09:18:14.448906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 09:18:14.448906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: from cryptography.utils import int_from_bytes Jul 04 09:18:16.847893 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:18:16.848460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:18:16.848687 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:18:16.849120 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:18:16.849334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:18:16.849726 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.850057 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.850382 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.850707 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.851037 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.851351 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.851674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.851996 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.852326 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.852538 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 09:18:16.852984 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.852984 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.853238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-4-iscsi {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.854111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.854248 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 09:18:16.854426 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.854742 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.854937 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 09:18:16.855100 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.855211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 09:18:16.855379 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 09:18:16.855476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.855681 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.855795 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.855990 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.856099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.856401 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.856512 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.856730 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.857084 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.857579 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.857715 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.858188 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.858312 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.858611 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.858960 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.859117 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.859473 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.859760 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.859882 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.860092 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.860221 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.860422 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.860549 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.860750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-4-iscsi {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.860884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.861081 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.861355 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.861468 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.861677 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.861807 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-4-iscsi {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.862003 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.862116 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.862315 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.862439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.862647 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.862769 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.862973 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.863167 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.863455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.863562 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.863773 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.863893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.864092 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.864304 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.864504 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.864629 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.864827 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.865012 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.865142 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.865331 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.865431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.865638 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.865805 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.865963 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.866157 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.866311 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.866470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.866625 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.866793 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.867005 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.867155 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-4-iscsi {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.867329 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.867514 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.867678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.867835 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.867987 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.868141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.868382 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.868553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.868732 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.868923 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.869686 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.869855 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.870001 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.870226 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.870386 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.870533 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.870684 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.870997 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.871159 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.871316 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.871472 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.871630 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.871794 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.871940 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.872099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.872256 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.872414 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.872567 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.872712 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.872864 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.873019 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.873203 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.873348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.873501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.873656 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.873811 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.873955 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.873955 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.874245 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.874390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.874544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.874705 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.874851 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.875005 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.875157 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.875310 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.875477 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.875633 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.875780 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.875924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.876076 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.876221 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.876379 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.876524 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.876671 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.876814 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.876984 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.877167 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.877342 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.877488 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.877641 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.877794 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.877950 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.878095 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.878249 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.878394 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.878643 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.878803 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.878949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.879108 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.879261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.879417 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.879562 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.879716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.879862 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.880014 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.880173 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.880324 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.880480 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.880625 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.880776 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.880954 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.881311 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.881519 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.881682 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.881831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.881983 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.882142 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.882295 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.882456 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.882601 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.882746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.882898 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.883057 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.883211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.883364 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.883526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.883703 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.883859 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.884016 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.884170 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.884324 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.884476 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.884665 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.884997 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.885189 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.885336 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.885481 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.885625 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.885782 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.886009 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.886166 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.886319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.886464 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.886608 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.886761 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.886922 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.887076 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.887229 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.887386 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.887532 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.887686 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.887858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.888005 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.888159 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.888341 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.888508 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.888688 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.888913 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.889134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.889306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.889461 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.889617 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.889763 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.889907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.890061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.890216 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.890372 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.890517 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.890668 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.890820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.890973 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.891153 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.891469 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.891635 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.891792 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.891939 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.892098 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.892253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.892399 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.892550 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.892708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.892860 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.893014 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.893191 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.893350 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.893506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.893660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.893806 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.893957 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.894123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.894276 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.894432 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.894586 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.894738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.894883 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.895034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.895178 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.895340 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.895500 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.895651 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.895804 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.895949 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.896103 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.896257 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.896413 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.896560 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.896712 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.896867 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.897013 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.897212 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.897367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.897523 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.897677 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.897823 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.897982 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.898138 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.898292 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.898452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.898598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.898749 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.898921 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.899139 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.899297 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.899443 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.899587 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.899740 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.899898 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.900052 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.900262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.900446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.900598 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.900759 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 09:18:16.901111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.901281 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.901614 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.901784 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.901939 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.902095 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.902251 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.902398 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.902578 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.902727 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.902884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.903040 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.903194 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.903348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.903495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.903640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.903793 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.903950 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.904106 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.904253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.904409 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.904561 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.904732 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.904894 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.905083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.905235 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.905381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.905536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.905690 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.905846 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.905992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.906143 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.906296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.906453 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.906605 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.906761 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.906913 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.907067 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.907221 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.907367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.907519 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.907681 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.907827 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.907999 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.908159 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.908336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.908505 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.908732 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.908884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.909111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.909335 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.909505 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.909665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.909820 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.909967 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.910117 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.910271 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.910417 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.910574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.910731 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.910877 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.911029 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.911175 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.911320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.911479 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.911808 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.911959 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.912111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.912259 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.912404 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.912626 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.912786 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.912932 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.913121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.913272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.913434 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.913588 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.913742 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.913889 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.914042 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.914195 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.914351 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.914508 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.914661 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.914818 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.914961 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.915105 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.915260 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.915423 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.915569 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.915714 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.916396 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.916712 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.916871 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.917095 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.917265 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.917419 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.917584 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.917771 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.917948 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.918096 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.918250 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.918396 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.918549 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.918704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.918858 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.919004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.919156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.919319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.919537 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.919711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.919866 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.920020 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.920166 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.920318 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.920487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.920651 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.920804 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.920954 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.921149 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.921305 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.921456 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.921621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.921965 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.922125 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.922292 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.922448 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.922613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.922767 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.922927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.923079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.923231 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.923391 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.923557 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.923719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.923883 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.924043 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.924204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.924367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.924529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.924529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.924830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.925015 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.925362 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.925683 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.926017 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.926637 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.926766 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.926963 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.927088 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.927464 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.927653 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.927835 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.928004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.928179 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.928348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.928538 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.928642 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.928970 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.929096 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.929328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.929495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.929665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.929821 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.929974 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.930129 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.930282 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.930443 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.930612 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.930792 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.930962 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.931118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.931279 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.932083 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.932461 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.932636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.932800 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.932965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.933163 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.933340 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.933503 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.933657 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.933820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.933981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.934144 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.934315 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.934490 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.934644 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.934797 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.934986 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.935156 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.935322 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.935477 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.935630 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.935781 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.935943 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.936716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.936884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.937077 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.937262 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.937420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.937420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.937726 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.937881 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.938041 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.938196 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.938349 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.938503 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.938665 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.938819 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.938973 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.939135 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.939308 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.939464 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.939464 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.939776 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.939932 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.940092 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.940255 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.940418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.940573 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.940726 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.940888 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.941070 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.941230 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.941421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.941582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.941737 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.941889 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.942051 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.942204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.942366 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.942521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.942682 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.942845 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.942845 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.943145 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.943324 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.943478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.943639 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.943794 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.943946 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.944099 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.944260 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.944422 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.944584 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.944746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.944901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.945080 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.945241 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.945405 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.945570 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.945724 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.945920 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.946158 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.946315 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.946476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.946629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.946780 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.946943 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.947193 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.947382 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.947538 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.947704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.947704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.948009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.948180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.948364 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.948525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.948679 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.948841 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.949016 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.949241 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.949464 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.949692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.949916 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.950164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.950418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.950643 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.950869 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.951095 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.951319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.951541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.951766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.951979 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.951979 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.952383 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.952595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.952805 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.953070 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.953350 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.953643 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.953906 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.954153 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.954153 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.954662 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.954851 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.955017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.955180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.955345 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.955509 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.955676 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.955829 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.956077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.956339 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.956596 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.956872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.957079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.957241 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.957396 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.957396 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.957396 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.957396 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.957396 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.958134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.958288 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.958442 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.958614 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.958778 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.958932 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.959093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.959247 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.959399 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.959399 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.959399 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.959837 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.959997 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.960170 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.960333 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.960497 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.960652 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.960652 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.960942 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.961142 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.961316 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.961490 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.961645 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.961798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.961951 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.962104 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.962266 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.962429 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.962592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.963273 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.963691 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.963847 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.964016 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.964171 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.964333 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.964495 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.964657 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.964820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.964820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.965164 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.965331 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.965498 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.965653 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.965806 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.965969 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.966123 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.966284 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.966446 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.966609 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.966772 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.966939 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.967125 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.967280 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.967433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.967596 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.967765 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.967928 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.968091 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.968244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.968396 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.968556 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.968724 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.968724 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.969026 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.969261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.969428 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.969428 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.969758 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.969915 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.970068 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.970221 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.970383 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.970546 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.970709 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.970863 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.971016 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.971169 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.971335 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.971503 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.971666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.971838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.972003 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.972172 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.972172 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.972172 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.972627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.972789 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.972989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.973169 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.973336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.973501 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.973658 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.973811 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.973975 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.974199 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.974456 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.974687 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.974687 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.975149 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.975399 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.975631 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.975859 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.976102 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.976346 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.976601 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.976822 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.977077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.977308 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.977546 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.977769 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.977989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.978206 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.978493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.979992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.981186 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.981427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.981703 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.981936 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.982158 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.982377 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.982607 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.982843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.983227 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.983454 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.983674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.983904 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.984142 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.984372 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.984609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.984838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.985092 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.985316 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.985538 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.985759 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.985999 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.985999 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.986421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.986421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.986848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.987090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.987308 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.987539 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.987539 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.987539 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.987539 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.988398 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.988620 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.988620 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.989090 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.989330 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.989547 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.989789 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.990008 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.990237 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.990462 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.990688 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.990688 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.991136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.991358 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.991587 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.991814 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.992034 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.992266 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.992494 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.992740 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.992967 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.993215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.993215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.993746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.993994 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.994230 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.994461 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.994682 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.994933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.995166 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.995457 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.995653 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.995874 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.995874 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.996246 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.996451 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.996645 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.996851 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.996989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.997142 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.997301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.997436 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.997567 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.997709 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.997843 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.997983 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.998182 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.998321 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.998456 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.998589 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.998720 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.998863 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.999022 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.999153 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.999343 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.999538 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.999707 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.999843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:16.999989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.000124 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.000255 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.000398 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.000398 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.000398 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.000784 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.000929 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.001082 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.001230 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.001365 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.001515 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.001669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.001807 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.001940 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.002082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.002082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.002362 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.002504 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.002647 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.002777 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.002918 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.003099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.003294 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.003433 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.003572 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.003716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.003903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.004061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.004198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.004330 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.004474 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.004617 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.004756 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.004903 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.005122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.005259 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.005392 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.005538 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.005670 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.005822 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.005957 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.006092 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.006233 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.006364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.006514 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.006667 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.006800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.006941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.007087 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.007222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.007363 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.007504 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.007638 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.007780 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.007911 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.008051 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.008209 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.008342 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.008474 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.008602 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.008728 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.008845 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.008944 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.009084 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.009084 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.009261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.009349 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.009435 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.009556 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.009647 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.009735 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.009816 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.009890 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.010048 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.010150 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.010238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.010323 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.010416 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.010503 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.010603 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.010699 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.010795 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.010933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011024 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011110 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011291 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011376 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011460 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011644 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011738 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011826 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.011911 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.012003 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.012096 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.012193 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.012288 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.012374 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.012468 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.012554 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.012639 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.012741 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.012921 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.013080 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.013197 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.013309 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.013309 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.013566 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.013710 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.013851 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.014045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.014189 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.014322 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.014462 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.014600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.014731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.014731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.014975 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.015124 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.015264 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.015264 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.015501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.015639 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.015767 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.015908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.016037 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.016163 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.016288 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.016416 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.016649 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.016808 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.016950 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.018060 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.018268 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.018435 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.018596 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.018778 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.018956 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.019137 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.019337 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.019516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.019695 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.019889 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.020068 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.020195 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.020317 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.020437 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.020646 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.020771 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.020885 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.021004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.021190 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.021307 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.021439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.021613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.021707 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.021794 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.021921 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.022017 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.022114 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.022201 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.022287 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.022380 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.022467 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.022562 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.022646 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.023572 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.023751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.023919 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.024096 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.024272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.024434 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.024565 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.024702 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.024998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.025687 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.025854 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.025986 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.026115 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.026245 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.026245 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.026245 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.026245 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.026725 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.026855 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.026983 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.027114 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.027252 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.027401 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.027531 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.027659 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.027785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.027921 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.028068 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.028208 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.028345 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.028472 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.028607 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.028734 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.028734 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.028992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.029143 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.029271 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.029397 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.029539 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.029686 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.029835 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.029980 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.030118 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.030259 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.030396 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.030527 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.030703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.030848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.030998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.031153 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.031294 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.031444 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.031644 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.031742 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.031843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.031943 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032038 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032231 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032418 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032506 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032685 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032771 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032864 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.032965 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.033092 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.033237 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.033341 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.033417 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.033540 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.033680 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.033777 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.033872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.033968 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034243 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034456 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034546 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034632 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034732 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.034993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.035080 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.035173 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.035267 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.035472 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.035616 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.035788 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.035932 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.036105 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.036253 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.036421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.036556 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.036729 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.036862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.037067 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.037225 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.037392 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.037527 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.037708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.037850 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.038041 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.038176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.038353 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.038496 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.038671 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.038878 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.039062 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.039198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.039336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.039464 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.039590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.039718 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.039952 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.040094 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.040235 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.040365 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.040502 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.040651 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.040818 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.041717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.041889 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.042060 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.042238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.042452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.042604 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.042744 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.042895 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.043052 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.043156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.043258 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.043387 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.043507 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.043638 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.043813 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.043949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.044149 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.044245 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.044466 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.044599 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.044800 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.044926 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.045155 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.045268 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.045472 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.045568 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.045790 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.045975 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.046106 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.046356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.046452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.046708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.046812 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.047049 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.047186 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.047375 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.047509 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.047703 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.047839 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.048038 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.048183 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.048353 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.048486 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.048666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.048807 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.049136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.049301 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.049434 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.049572 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.049705 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.049846 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.049985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.050123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.050268 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.050408 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.050538 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.050681 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.050821 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.050960 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.051098 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.051258 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.051420 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.051628 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.051762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.051901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.052059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.052206 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.052390 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.052673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.052824 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.052981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.053151 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.053309 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.053472 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.053666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.053870 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.054013 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.054150 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.054287 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.054429 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.054584 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.054714 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.054915 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.055049 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.055249 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.055354 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.055567 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.055670 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.055895 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.055997 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.056216 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.056311 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.056633 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.056729 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.057082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.057195 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.057427 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.057529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.057753 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.057861 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.058071 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.058172 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.058393 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.058489 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.058706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.058802 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.059029 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.059125 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.059352 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.059455 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.059674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.059769 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.060005 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.060242 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.060344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.060584 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.060687 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.060908 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.061003 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.061257 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.061362 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.061579 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.061683 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.061903 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.062011 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.062223 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.062326 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.062541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.062637 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.062859 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.062966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.063178 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.063284 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.063497 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.063592 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.063834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.063931 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.064160 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.064253 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.064484 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.064579 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.064809 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.064913 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.065164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.065276 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.065512 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.065696 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.065836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.066026 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.066157 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.066372 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.066522 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.066710 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.066844 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.067045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.067146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.067372 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.067475 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.067700 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.067799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.068038 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.068132 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.068357 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.068452 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.068672 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.068787 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.068987 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.069110 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.069333 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.069429 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.069651 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.069754 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.069965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.070070 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.070284 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.070460 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.070603 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.070698 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.070930 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.071024 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.071254 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.071359 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.071579 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.071799 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.071901 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.072190 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.072362 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.072512 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.072772 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.072874 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.073199 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.073361 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.073533 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.073674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.073852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.074014 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.074191 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.074338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.074511 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.074666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.074830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.074977 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.075158 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.075302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.075481 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.075637 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.075798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.075952 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.076114 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.076264 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.076435 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.076580 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.076754 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.076894 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.077085 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.077303 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.077411 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.077669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.077771 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.077990 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.078084 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.078305 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.078401 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.078632 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.078734 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.078948 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.079041 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.079267 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.079490 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.079592 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.079845 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.079955 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.080166 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.080270 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.080481 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.080576 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.080799 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.080904 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.081137 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.081251 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.081454 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.081548 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.081768 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.081869 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.082090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.082187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.082399 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.082500 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.082715 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.082817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.083075 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.083322 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.083417 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.083643 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.083748 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.083956 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.084064 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.084274 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.084396 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.084589 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.084684 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.084932 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.085086 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.085289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.085404 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.085610 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.085705 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.085957 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.086058 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.086271 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.086366 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.086583 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.086815 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.086920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.087163 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.087259 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.087494 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.087607 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.088711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.088830 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.089025 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.089157 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.089361 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.089466 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.089679 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.089776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.089991 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.090086 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.090310 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.090404 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.090624 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.090720 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.090943 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.091045 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.091253 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.091346 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.091569 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.091665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.091886 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.091981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.092207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.092310 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.092529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.092633 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.092843 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.092940 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.093184 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.093300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.093501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.093603 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.093818 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.093912 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.094133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.094235 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.094448 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.094568 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.094774 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.094878 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.095110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.095213 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.095444 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.095649 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.095776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.095993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.096095 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.096320 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.096416 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.096656 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.096759 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.096995 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.097153 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.097336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.097433 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.097650 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.097745 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.097963 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.098072 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.098294 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.098397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.098612 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.098708 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.098928 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.099031 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.099288 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.099460 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.099557 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.099787 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.099896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.100121 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.100216 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.100454 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.100559 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.100767 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.100876 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.101103 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.101214 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.101423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.101527 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.101745 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.101916 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.102061 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.102156 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.102374 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.102477 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.102695 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.102799 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.103047 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.103150 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.104085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.104191 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.104297 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.104394 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.104648 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.104770 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.104965 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.105076 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.105319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.105422 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.105637 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.105739 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.105951 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.106053 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.106271 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.106366 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.106586 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.106681 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.106900 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.107009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.107221 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.107317 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.107533 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.107633 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.107843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.108052 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.108149 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.108379 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.108528 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.108707 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.108812 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.109075 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.109177 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.109379 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.109488 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.109691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.109799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.110006 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.110109 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.110318 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.110413 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.110629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.110733 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.110945 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.111049 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.111256 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.112135 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.112239 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.112337 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.112433 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.112529 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.112624 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.112710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.112810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.112899 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.112972 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.113078 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.113157 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.113255 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.113453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.113550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.113788 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.113884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.114109 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.114211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.114422 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.114527 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.114733 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.114856 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.115051 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.115157 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.115364 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.115503 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.115674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.115779 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.115983 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.116093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.116296 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.116400 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.116609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.116705 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.116918 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.117023 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.117256 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.117361 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.117568 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.117672 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.117878 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.117983 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.118190 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.118298 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.118498 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.118601 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.118813 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.119455 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.119664 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.119820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.120032 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.120223 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.120330 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.120420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.120586 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.120719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.120895 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.121062 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.121273 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.121399 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.121614 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.121721 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.121940 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.122044 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.122273 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.122369 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.122602 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.122703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.122915 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.123026 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.123232 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.123327 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.123560 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.123662 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.123882 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.123990 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.124200 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.124302 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.124516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.124619 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.124843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.124936 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.125189 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.125288 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.125512 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.125619 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.125832 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.125938 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.126148 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.126244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.126464 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.126568 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.126782 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.126886 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.127116 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.127222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.127451 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.127546 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.127765 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.127861 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.128015 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:18:17.128108 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.128404 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.128728 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.129056 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.129386 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.129723 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.130040 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.130354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.130674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.130989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.131306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.131635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.131955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.132286 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.132618 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.132932 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.133290 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.133623 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.133978 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.134297 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.135309 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.135584 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.135907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.136225 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.136536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 09:18:17.136785 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 09:18:17.191541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO dbcounter [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Registered counter for database nova_api Jul 04 09:18:17.200240 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO dbcounter [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Registered counter for database nova_api Jul 04 09:18:17.212292 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:18:17.219244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writer thread running {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:18:17.220548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_db.sqlalchemy.engines [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:18:17.227001 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writer thread running {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:18:17.275608 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.context [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac196d60-a3f3-44cc-90e3-79ce8ad134b8(cell1) {{(pid=117665) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 09:18:17.279736 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:17.281379 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:17.282195 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:17.282810 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.context [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac196d60-a3f3-44cc-90e3-79ce8ad134b8(cell1) {{(pid=117664) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 09:18:17.284181 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:17.286232 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO dbcounter [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Registered counter for database nova_cell0 Jul 04 09:18:17.287165 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:17.288756 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:17.289624 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:18:17.290266 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO dbcounter [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Registered counter for database nova_cell1 Jul 04 09:18:17.291663 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:18:17.293691 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO dbcounter [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Registered counter for database nova_cell0 Jul 04 09:18:17.297731 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:18:17.297953 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO dbcounter [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Registered counter for database nova_cell1 Jul 04 09:18:17.300734 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:18:17.305703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writer thread running {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:18:17.305957 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_db.sqlalchemy.engines [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:18:17.307402 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_db.sqlalchemy.engines [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:18:17.312411 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writer thread running {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:18:17.314841 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writer thread running {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:18:17.456426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writer thread running {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:18:17.465504 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO dbcounter [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Registered counter for database nova_cell0 Jul 04 09:18:17.468100 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO dbcounter [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Registered counter for database nova_cell0 Jul 04 09:18:17.472154 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_db.sqlalchemy.engines [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:18:17.474863 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 09:18:17.476785 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writer thread running {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:18:17.480134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writer thread running {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 09:18:17.806151 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: WARNING keystonemiddleware.auth_token [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:18:17.807568 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: WARNING keystonemiddleware.auth_token [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:18:17.813755 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: WARNING keystonemiddleware.auth_token [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:18:17.814923 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: WARNING keystonemiddleware.auth_token [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:18:18.164429 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: WARNING keystonemiddleware.auth_token [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:18:18.171772 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: WARNING keystonemiddleware.auth_token [None req-b8d41184-3d57-4fa8-8545-06ff7cd979d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:18:18.173536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: WARNING keystonemiddleware.auth_token [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 09:18:18.177211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55677f7fa9c0 pid: 117665 (default app) Jul 04 09:18:18.179509 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: WARNING keystonemiddleware.auth_token [None req-84570622-43c3-4d75-aabc-d9360f0c644c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 09:18:18.185604 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55677f7fa9c0 pid: 117664 (default app) Jul 04 09:18:59.717320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.718153 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.719342 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.720689 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.987161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.988045 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.988815 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:18:59.989660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:00.990874 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-583a5a0c-5f76-48fd-b46b-5bb2badb1114 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] Action: 'create', calling method: .version_select at 0x7fad80b91700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1258820026", "metadata": {"Type": "work"}}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:01.353076 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a4b9b3b9-f275-4c68-a7dd-396e8ae8bee0 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Action: 'create', calling method: .version_select at 0x7fad80b91700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-332732227", "metadata": {"Type": "work"}}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a4b9b3b9-f275-4c68-a7dd-396e8ae8bee0 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Request method failure captured: Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 121 Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCDRVf-aebv-p8AuRSwZ7IAkfh7T5LJOCuiNMPeo7nuSkp0wK12GQ_5FYUHBVxFx-WEOowCpgSa3x2urZhVc7CzNl92HUoHQjq8S9DuVU7PgTlzSBze-3ojWpwAD9qOMwcFt-AgDg4yifjCIPmoFByT6kcgqIO2nLJVYNh_SrdMVR8 Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:19:01.377574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_65444bb2b7694e32a4acb48edcdadb5f", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: ab95cd8d0d6643d7835492a40acc8841 Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-332732227", "metadata": {"Type": "work"}}} Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: Jul 04 09:19:01.379478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-332732227', 'metadata': {'Type': 'work'}}}} Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise error Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi '#$%' Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:19:01.380516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 09:19:01.381993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 09:19:01.385344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 09:19:01.385344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.385344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a4b9b3b9-f275-4c68-a7dd-396e8ae8bee0 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:19:01.385344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a4b9b3b9-f275-4c68-a7dd-396e8ae8bee0 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.398175 Jul 04 09:19:01.387349 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 1/1] 10.222.0.71 () {60 vars in 1155 bytes} [Mon Jul 4 09:18:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1407 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:19:01.393479 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-36355646-7329-48d9-8f13-4e564ad49f1a tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Action: 'create', calling method: .version_select at 0x7fad80b089d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-57382396", "metadata": {"Type": "work"}}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-36355646-7329-48d9-8f13-4e564ad49f1a tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Request method failure captured: Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 118 Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCDRVf-aebv-p8AuRSwZ7IAkfh7T5LJOCuiNMPeo7nuSkp0wK12GQ_5FYUHBVxFx-WEOowCpgSa3x2urZhVc7CzNl92HUoHQjq8S9DuVU7PgTlzSBze-3ojWpwAD9qOMwcFt-AgDg4yifjCIPmoFByT6kcgqIO2nLJVYNh_SrdMVR8 Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:19:01.400384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_65444bb2b7694e32a4acb48edcdadb5f", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: ab95cd8d0d6643d7835492a40acc8841 Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-57382396", "metadata": {"Type": "work"}}} Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: Jul 04 09:19:01.401891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-57382396', 'metadata': {'Type': 'work'}}}} Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise error Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi '0' Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:19:01.402706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 09:19:01.404009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 09:19:01.405799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 09:19:01.405799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.405799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-36355646-7329-48d9-8f13-4e564ad49f1a tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:19:01.405799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-36355646-7329-48d9-8f13-4e564ad49f1a tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016013 Jul 04 09:19:01.405799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 2/2] 10.222.0.71 () {60 vars in 1155 bytes} [Mon Jul 4 09:19:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:19:01.432452 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2b499da3-6dca-4fbd-af59-16041544dba6 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Action: 'create', calling method: .version_select at 0x7fad80b91a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-165551279", "metadata": {"Type": "work"}}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2b499da3-6dca-4fbd-af59-16041544dba6 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Request method failure captured: Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 118 Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCDRVf-aebv-p8AuRSwZ7IAkfh7T5LJOCuiNMPeo7nuSkp0wK12GQ_5FYUHBVxFx-WEOowCpgSa3x2urZhVc7CzNl92HUoHQjq8S9DuVU7PgTlzSBze-3ojWpwAD9qOMwcFt-AgDg4yifjCIPmoFByT6kcgqIO2nLJVYNh_SrdMVR8 Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:19:01.438300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_65444bb2b7694e32a4acb48edcdadb5f", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: ab95cd8d0d6643d7835492a40acc8841 Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-165551279", "metadata": {"Type": "work"}}} Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: Jul 04 09:19:01.439873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-165551279', 'metadata': {'Type': 'work'}}}} Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise error Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi '' Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:19:01.440817 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 09:19:01.442433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 09:19:01.443936 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 09:19:01.443936 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:01.443936 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2b499da3-6dca-4fbd-af59-16041544dba6 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:19:01.443936 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2b499da3-6dca-4fbd-af59-16041544dba6 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024989 Jul 04 09:19:01.450089 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 3/3] 10.222.0.71 () {60 vars in 1155 bytes} [Mon Jul 4 09:19:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:19:01.456359 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-41388147-c835-462f-a136-9bf8408ccd44 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Calling method '.version_select at 0x7fad80abc670>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:02.520304 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-41388147-c835-462f-a136-9bf8408ccd44 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] HTTP exception thrown: Volume tempest-invalid-684270806 could not be found. Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-41388147-c835-462f-a136-9bf8408ccd44 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Request method failure captured: Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-684270806 HTTP/1.1 Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCDRVf-aebv-p8AuRSwZ7IAkfh7T5LJOCuiNMPeo7nuSkp0wK12GQ_5FYUHBVxFx-WEOowCpgSa3x2urZhVc7CzNl92HUoHQjq8S9DuVU7PgTlzSBze-3ojWpwAD9qOMwcFt-AgDg4yifjCIPmoFByT6kcgqIO2nLJVYNh_SrdMVR8 Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:19:02.524122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_65444bb2b7694e32a4acb48edcdadb5f", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: ab95cd8d0d6643d7835492a40acc8841 Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Volume tempest-invalid-684270806 could not be found. Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'tempest-invalid-684270806'} Jul 04 09:19:02.525544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-684270806 could not be found. (HTTP 404) (Request-ID: req-f20b7867-50e4-4618-ba1d-30c0dae56bf1) Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:02.526334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:19:02.527495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-684270806 could not be found. Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:19:02.528592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-684270806 could not be found. Jul 04 09:19:02.529791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.529791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:02.529791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.529791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:02.529791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:02.529791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:02.529791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:19:02.529791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:19:02.529791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-684270806 could not be found. Jul 04 09:19:02.529791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.533406 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-41388147-c835-462f-a136-9bf8408ccd44 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Returning 404 to user: Volume tempest-invalid-684270806 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:19:02.533406 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-41388147-c835-462f-a136-9bf8408ccd44 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/tempest-invalid-684270806" status: 404 len: 98 microversion: 2.1 time: 1.081432 Jul 04 09:19:02.533606 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 4/4] 10.222.0.71 () {58 vars in 1214 bytes} [Mon Jul 4 09:19:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-684270806 => generated 98 bytes in 1082 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 04 09:19:02.544735 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1ed5b5ed-4069-4e7c-bdf6-dc8bd478feed tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004805 Jul 04 09:19:02.550036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 5/5] 10.222.0.71 () {58 vars in 1139 bytes} [Mon Jul 4 09:19:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 04 09:19:02.562167 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7555bc74-9dd3-4b8c-9694-c3f25ce95b53 tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004722 Jul 04 09:19:02.563213 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 6/6] 10.222.0.71 () {58 vars in 1136 bytes} [Mon Jul 4 09:19:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 04 09:19:02.577266 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9f03190c-f847-49d1-a9bc-bdf5abbbcfce tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Calling method '.version_select at 0x7fad809e6a60>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:02.610854 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-583a5a0c-5f76-48fd-b46b-5bb2badb1114 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.901439 Jul 04 09:19:02.611506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 1/7] 10.222.0.71 () {60 vars in 1155 bytes} [Mon Jul 4 09:18:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2904 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 04 09:19:02.626093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1728432d-afe9-4144-a20d-d3a57ddd1957 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] Calling method '.version_select at 0x7fad80a58550>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:02.890227 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-9f03190c-f847-49d1-a9bc-bdf5abbbcfce tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] HTTP exception thrown: Volume 74bbbb3e-2c8d-490d-ab17-8711c23fa79a could not be found. Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9f03190c-f847-49d1-a9bc-bdf5abbbcfce tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Request method failure captured: Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/os-volumes/74bbbb3e-2c8d-490d-ab17-8711c23fa79a HTTP/1.1 Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCDRVf-aebv-p8AuRSwZ7IAkfh7T5LJOCuiNMPeo7nuSkp0wK12GQ_5FYUHBVxFx-WEOowCpgSa3x2urZhVc7CzNl92HUoHQjq8S9DuVU7PgTlzSBze-3ojWpwAD9qOMwcFt-AgDg4yifjCIPmoFByT6kcgqIO2nLJVYNh_SrdMVR8 Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:19:02.892459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_65444bb2b7694e32a4acb48edcdadb5f", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: ab95cd8d0d6643d7835492a40acc8841 Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Volume 74bbbb3e-2c8d-490d-ab17-8711c23fa79a could not be found. Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '74bbbb3e-2c8d-490d-ab17-8711c23fa79a'} Jul 04 09:19:02.894085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74bbbb3e-2c8d-490d-ab17-8711c23fa79a could not be found. (HTTP 404) (Request-ID: req-4c37e899-63ea-493a-b9cf-cbd9c972e6c7) Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:02.894867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:19:02.896301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74bbbb3e-2c8d-490d-ab17-8711c23fa79a could not be found. Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 09:19:02.897493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74bbbb3e-2c8d-490d-ab17-8711c23fa79a could not be found. Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74bbbb3e-2c8d-490d-ab17-8711c23fa79a could not be found. Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9f03190c-f847-49d1-a9bc-bdf5abbbcfce tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Returning 404 to user: Volume 74bbbb3e-2c8d-490d-ab17-8711c23fa79a could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9f03190c-f847-49d1-a9bc-bdf5abbbcfce tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/74bbbb3e-2c8d-490d-ab17-8711c23fa79a" status: 404 len: 109 microversion: 2.1 time: 0.323614 Jul 04 09:19:02.898588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 7/8] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 4 09:19:02 2022] DELETE /compute/v2.1/os-volumes/74bbbb3e-2c8d-490d-ab17-8711c23fa79a => generated 109 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:19:02.910061 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fd342d9b-5ff7-4ec7-b85d-8fc633d727bb tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Calling method '.version_select at 0x7fad809e6f70>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:02.948950 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1728432d-afe9-4144-a20d-d3a57ddd1957 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0" status: 200 len: 353 microversion: 2.1 time: 0.328078 Jul 04 09:19:02.949722 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 2/9] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:19:02 2022] GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0 => generated 353 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:03.000876 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-fd342d9b-5ff7-4ec7-b85d-8fc633d727bb tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] HTTP exception thrown: Volume 2b4bce2c-765e-4136-bdbc-4cfe91af7d28 could not be found. Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fd342d9b-5ff7-4ec7-b85d-8fc633d727bb tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Request method failure captured: Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/os-volumes/2b4bce2c-765e-4136-bdbc-4cfe91af7d28 HTTP/1.1 Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCDRVf-aebv-p8AuRSwZ7IAkfh7T5LJOCuiNMPeo7nuSkp0wK12GQ_5FYUHBVxFx-WEOowCpgSa3x2urZhVc7CzNl92HUoHQjq8S9DuVU7PgTlzSBze-3ojWpwAD9qOMwcFt-AgDg4yifjCIPmoFByT6kcgqIO2nLJVYNh_SrdMVR8 Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:19:03.003101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/65444bb2b7694e32a4acb48edcdadb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_65444bb2b7694e32a4acb48edcdadb5f", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 65444bb2b7694e32a4acb48edcdadb5f Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesNegativeTest-546045284 Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: ab95cd8d0d6643d7835492a40acc8841 Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesNegativeTest-546045284-project Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Volume 2b4bce2c-765e-4136-bdbc-4cfe91af7d28 could not be found. Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '2b4bce2c-765e-4136-bdbc-4cfe91af7d28'} Jul 04 09:19:03.004699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b4bce2c-765e-4136-bdbc-4cfe91af7d28 could not be found. (HTTP 404) (Request-ID: req-62bc0046-5029-4b3e-a538-537004133c49) Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:03.005673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:19:03.007079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b4bce2c-765e-4136-bdbc-4cfe91af7d28 could not be found. Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 09:19:03.008800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b4bce2c-765e-4136-bdbc-4cfe91af7d28 could not be found. Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b4bce2c-765e-4136-bdbc-4cfe91af7d28 could not be found. Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fd342d9b-5ff7-4ec7-b85d-8fc633d727bb tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] Returning 404 to user: Volume 2b4bce2c-765e-4136-bdbc-4cfe91af7d28 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fd342d9b-5ff7-4ec7-b85d-8fc633d727bb tempest-VolumesNegativeTest-546045284 tempest-VolumesNegativeTest-546045284-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/2b4bce2c-765e-4136-bdbc-4cfe91af7d28" status: 404 len: 109 microversion: 2.1 time: 0.100144 Jul 04 09:19:03.010204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 8/10] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:19:02 2022] GET /compute/v2.1/os-volumes/2b4bce2c-765e-4136-bdbc-4cfe91af7d28 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:19:03.963165 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a4e6419a-60a8-497a-bbb3-d01956d8cdbf tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] Calling method '.version_select at 0x7fad80a588b0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:04.052420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a4e6419a-60a8-497a-bbb3-d01956d8cdbf tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0" status: 200 len: 354 microversion: 2.1 time: 0.094320 Jul 04 09:19:04.052968 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 3/11] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:19:03 2022] GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:04.065814 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-91f5617a-49c7-46ad-8001-87f1da0d9be6 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] Calling method '.version_select at 0x7fad80abc160>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:04.172165 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-91f5617a-49c7-46ad-8001-87f1da0d9be6 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0" status: 200 len: 354 microversion: 2.1 time: 0.110961 Jul 04 09:19:04.184344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 9/12] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:19:04 2022] GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0 => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:04.190512 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c8baf150-c5ed-435d-af9f-75283a2302e7 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] Calling method '.version_select at 0x7fad80a58ca0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:04.333069 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c8baf150-c5ed-435d-af9f-75283a2302e7 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0" status: 202 len: 0 microversion: 2.1 time: 0.147337 Jul 04 09:19:04.333967 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 4/13] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 4 09:19:04 2022] DELETE /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:19:04.342556 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9a18ed08-2fc4-49c1-a3d3-97fa839d20be tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] Calling method '.version_select at 0x7fad80b08e50>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:04.440367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9a18ed08-2fc4-49c1-a3d3-97fa839d20be tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0" status: 200 len: 353 microversion: 2.1 time: 0.101704 Jul 04 09:19:04.445328 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 10/14] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:19:04 2022] GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:05.455018 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-57613f90-ce56-4089-bea9-3a3f3aec76f4 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] Calling method '.version_select at 0x7fad80a673a0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:05.507630 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-57613f90-ce56-4089-bea9-3a3f3aec76f4 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] HTTP exception thrown: Volume ca990dc4-1c85-4b83-8da9-32d13f2d84c0 could not be found. Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-57613f90-ce56-4089-bea9-3a3f3aec76f4 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] Request method failure captured: Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0 HTTP/1.1 Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCDDVJ0TaisgA9ffnLIA4Uf28sKr4llk7TYcYwlq5Oa_s06AD4ObucdxaKfXirxNpqYwV5uu4rzCDwaP-VA3iE7TAIaABe2tbBcXFvFoxHRcCUn-UlMu6Lcz8gW8u_I5npgMFpdRLNk3P1Pb35AT1WdiNxzE3ahICuztag0BZIB5i0 Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: c31a26aa218c45aa88c4c7d3a737ecb0 Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesGetTestJSON-1488414173 Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:19:05.512378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c31a26aa218c45aa88c4c7d3a737ecb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c31a26aa218c45aa88c4c7d3a737ecb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c31a26aa218c45aa88c4c7d3a737ecb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c31a26aa218c45aa88c4c7d3a737ecb0", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesGetTestJSON-1488414173 Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: c31a26aa218c45aa88c4c7d3a737ecb0 Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesGetTestJSON-1488414173 Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesGetTestJSON-1488414173-project Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: bae0f0daed8447eea4f6bce81598b6ae Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesGetTestJSON-1488414173-project Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Volume ca990dc4-1c85-4b83-8da9-32d13f2d84c0 could not be found. Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': 'ca990dc4-1c85-4b83-8da9-32d13f2d84c0'} Jul 04 09:19:05.513875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca990dc4-1c85-4b83-8da9-32d13f2d84c0 could not be found. (HTTP 404) (Request-ID: req-a5613b12-0aee-43b3-849c-b5499c831f94) Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:05.514692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:19:05.515852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca990dc4-1c85-4b83-8da9-32d13f2d84c0 could not be found. Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 09:19:05.517007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca990dc4-1c85-4b83-8da9-32d13f2d84c0 could not be found. Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca990dc4-1c85-4b83-8da9-32d13f2d84c0 could not be found. Jul 04 09:19:05.518093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:19:05.519910 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-57613f90-ce56-4089-bea9-3a3f3aec76f4 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] Returning 404 to user: Volume ca990dc4-1c85-4b83-8da9-32d13f2d84c0 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:19:05.520947 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-57613f90-ce56-4089-bea9-3a3f3aec76f4 tempest-VolumesGetTestJSON-1488414173 tempest-VolumesGetTestJSON-1488414173-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0" status: 404 len: 109 microversion: 2.1 time: 0.070700 Jul 04 09:19:05.529632 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 5/15] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:19:05 2022] GET /compute/v2.1/os-volumes/ca990dc4-1c85-4b83-8da9-32d13f2d84c0 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:19:13.476291 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-24c5b8a2-93ca-4124-ba1b-2855fbe464d7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: .version_select at 0x7fad80abc670>, body: {"keypair": {"name": "tempest-keypair-68454639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlqIm1rhMmS92y/Yp54t3D/BTtQW+3s35GGdYY2jc9jELRcuT02GH1jDUrfYwwn6qkZmyWBPlQBodXx84xOvjQRhnnFEbxjL1EGw7rovUtssTqc3iMBpIVtrL66jY89Sw=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:13.556018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-24c5b8a2-93ca-4124-ba1b-2855fbe464d7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for project ba157b0e49f1447e82755035db8728d5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:19:13.565339 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-24c5b8a2-93ca-4124-ba1b-2855fbe464d7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for user 6bc30b7d536444008e5b5bab45c5c438 and project ba157b0e49f1447e82755035db8728d5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:19:13.657772 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-24c5b8a2-93ca-4124-ba1b-2855fbe464d7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.009691 Jul 04 09:19:13.664855 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 11/16] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 4 09:19:12 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:17.140384 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-39817da5-98bc-4c47-8e58-8bbda96c2ce2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Action: 'create', calling method: .version_select at 0x7fad80a67ca0>, body: {"keypair": {"name": "tempest-keypair-811039041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpOyARsrducEG9pQ1IDI5qKLcWnbK7WdLa3/tY9GWuJ//WscX9bGhj7kS2UbAyjmQ2o9olSNH4TDgCbI2J39zZvz3ao/QpkwlcF898O2CO7bAzbqb+O7KNKjAd1BZYsxg=="}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:17.311804 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-39817da5-98bc-4c47-8e58-8bbda96c2ce2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Getting quotas for project 83d33ddd4b124161aba270998b7d2462. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:19:17.342687 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-39817da5-98bc-4c47-8e58-8bbda96c2ce2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Getting quotas for user 60d06d081a29460b8e85b0b301399f08 and project 83d33ddd4b124161aba270998b7d2462. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:19:17.510016 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-39817da5-98bc-4c47-8e58-8bbda96c2ce2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.624379 Jul 04 09:19:17.512991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 6/17] 10.222.0.71 () {62 vars in 1199 bytes} [Mon Jul 4 09:19:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 628 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 04 09:19:20.501322 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-19eadb00-2675-4ace-93d7-d081c5e0a870 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'create', calling method: .version_select at 0x7fad809bba60>, body: {"keypair": {"name": "tempest-keypair-987467661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ4aYSw0ZB4SzwgCDxqXsAB270fo0abRZptqq+QqdNuhF98Se/TZlEzIxtJNStqBc2k6Nyt8p71nkuAYjWQ0myRVZ7Ps+WPgEU2iQZz4FN+vzeNa+Cp1gPZpuYTKRnBxw=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:20.525562 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-19eadb00-2675-4ace-93d7-d081c5e0a870 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Getting quotas for project 123c769553a1424e9c6dba4569bfaea5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:19:20.530490 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-19eadb00-2675-4ace-93d7-d081c5e0a870 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Getting quotas for user e50f9b53a10a43fa9b5fec03d01f451f and project 123c769553a1424e9c6dba4569bfaea5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:19:20.573189 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-19eadb00-2675-4ace-93d7-d081c5e0a870 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.440122 Jul 04 09:19:20.574408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 12/18] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 4 09:19:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:21.195029 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2059084532", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da66c86d-f254-4d81-9f76-9ccab5e05cc2"}], "security_groups": [{"name": "tempest-securitygroup--1395610889"}], "key_name": "tempest-keypair-811039041", "user_data": "}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:21.649401 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] validate_networks() for [('da66c86d-f254-4d81-9f76-9ccab5e05cc2', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:19:21.822118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1798528845", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599dfd4b-618e-4261-9f6d-462c4cc71e5b"}], "security_groups": [{"name": "tempest-securitygroup--725262841"}], "key_name": "tempest-keypair-68454639", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:22.468475 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] validate_networks() for [('599dfd4b-618e-4261-9f6d-462c4cc71e5b', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:19:23.763981 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:19:23.765710 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:19:23.766396 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:19:23.767148 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:19:23.769214 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:19:23.780632 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:23.781386 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:23.782582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:23.783238 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:23.823478 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Getting quotas for project 83d33ddd4b124161aba270998b7d2462. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:19:23.828776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Getting quotas for user 60d06d081a29460b8e85b0b301399f08 and project 83d33ddd4b124161aba270998b7d2462. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:19:23.857017 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:19:23.878665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:19:24.032684 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-53c67161-3073-4d38-9855-1425c429abe9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.842827 Jul 04 09:19:24.033772 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 7/19] 10.222.0.71 () {62 vars in 1187 bytes} [Mon Jul 4 09:19:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 2845 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 04 09:19:24.080953 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:19:24.081607 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:19:24.081897 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:19:24.082476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:19:24.082986 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:19:24.104690 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:24.111326 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:24.113189 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:24.113952 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:24.191835 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2017947269", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "networks": [{"uuid": "11f98153-aec7-476e-b30e-2afb9ffd87c6"}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:24.211874 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for project ba157b0e49f1447e82755035db8728d5. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:19:24.216002 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for user 6bc30b7d536444008e5b5bab45c5c438 and project ba157b0e49f1447e82755035db8728d5. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:19:24.290449 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:19:24.303295 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:19:24.449197 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] validate_networks() for [('11f98153-aec7-476e-b30e-2afb9ffd87c6', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:19:24.593495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-56bdf112-550a-4e16-9ec8-6301f79772ad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.775808 Jul 04 09:19:24.598325 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 13/20] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:19:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 2783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:19:24.615829 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b6df648f-fa4b-47dd-89cf-34a3df9f552a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:24.625601 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b6df648f-fa4b-47dd-89cf-34a3df9f552a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:25.284946 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b6df648f-fa4b-47dd-89cf-34a3df9f552a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:25.337854 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b6df648f-fa4b-47dd-89cf-34a3df9f552a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:25.342616 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b6df648f-fa4b-47dd-89cf-34a3df9f552a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:25.344319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b6df648f-fa4b-47dd-89cf-34a3df9f552a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1281 microversion: 2.20 time: 0.740674 Jul 04 09:19:25.345265 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 14/21] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:24 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1281 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:25.353305 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-da04b96d-6d97-47e1-9f62-e6284272a6db tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:25.354146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-da04b96d-6d97-47e1-9f62-e6284272a6db tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:25.875487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-da04b96d-6d97-47e1-9f62-e6284272a6db tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:25.884208 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-da04b96d-6d97-47e1-9f62-e6284272a6db tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1240 microversion: 2.1 time: 0.537428 Jul 04 09:19:25.909313 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 15/22] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:25 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1240 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:26.371815 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-203b5f1a-b112-4680-a44b-c60976832821 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:26.376623 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-203b5f1a-b112-4680-a44b-c60976832821 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:26.403233 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-203b5f1a-b112-4680-a44b-c60976832821 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:26.415794 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-203b5f1a-b112-4680-a44b-c60976832821 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:26.417591 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-203b5f1a-b112-4680-a44b-c60976832821 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:26.418372 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-203b5f1a-b112-4680-a44b-c60976832821 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:27.068989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-203b5f1a-b112-4680-a44b-c60976832821 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:27.106965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-203b5f1a-b112-4680-a44b-c60976832821 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:27.120252 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-203b5f1a-b112-4680-a44b-c60976832821 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:27.121452 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-203b5f1a-b112-4680-a44b-c60976832821 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1285 microversion: 2.20 time: 0.761473 Jul 04 09:19:27.122412 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 16/23] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:26 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1285 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:19:27.141309 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e54ed884-8169-4d03-920e-401d60004e0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:27.142053 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e54ed884-8169-4d03-920e-401d60004e0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:27.153842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e54ed884-8169-4d03-920e-401d60004e0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:27.154563 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e54ed884-8169-4d03-920e-401d60004e0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:27.155769 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e54ed884-8169-4d03-920e-401d60004e0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:27.156498 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e54ed884-8169-4d03-920e-401d60004e0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:27.363748 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e54ed884-8169-4d03-920e-401d60004e0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:27.378792 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e54ed884-8169-4d03-920e-401d60004e0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1292 microversion: 2.1 time: 0.252535 Jul 04 09:19:27.379768 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 17/24] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:27 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1292 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:27.469869 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:19:27.471080 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:19:27.471798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:19:27.472438 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:19:27.473106 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:19:27.494359 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:27.498356 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:27.500734 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:27.503066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:27.543685 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Getting quotas for project 9acebc31809343e0abdc39ee5a127961. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:19:27.549291 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Getting quotas for user e034114ab8244cc99dbf977b458a43f9 and project 9acebc31809343e0abdc39ee5a127961. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:19:27.566281 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:19:27.569224 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:19:27.646758 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-12ae1067-80d6-4c30-8082-00317619eb09 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.611321 Jul 04 09:19:27.649834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 8/25] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:19:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:19:27.661427 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6e245ff2-335b-491d-ae9b-2efb0aecdeaa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:27.662223 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6e245ff2-335b-491d-ae9b-2efb0aecdeaa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:28.116892 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6e245ff2-335b-491d-ae9b-2efb0aecdeaa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:28.145448 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e14e12b1-8d01-44cb-82d8-f6b21b75a97a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:28.146378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e14e12b1-8d01-44cb-82d8-f6b21b75a97a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:28.154603 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6e245ff2-335b-491d-ae9b-2efb0aecdeaa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1215 microversion: 2.1 time: 0.491858 Jul 04 09:19:28.170262 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 18/26] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:27 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1215 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:28.193767 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e14e12b1-8d01-44cb-82d8-f6b21b75a97a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:28.199187 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e14e12b1-8d01-44cb-82d8-f6b21b75a97a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:28.200387 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e14e12b1-8d01-44cb-82d8-f6b21b75a97a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:28.200945 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e14e12b1-8d01-44cb-82d8-f6b21b75a97a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:28.403762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e290d78e-0cf1-4706-8dd3-ded3f4b722ac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:28.404411 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e290d78e-0cf1-4706-8dd3-ded3f4b722ac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:28.430478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e290d78e-0cf1-4706-8dd3-ded3f4b722ac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:28.431153 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e290d78e-0cf1-4706-8dd3-ded3f4b722ac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:28.435348 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e290d78e-0cf1-4706-8dd3-ded3f4b722ac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:28.438038 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e290d78e-0cf1-4706-8dd3-ded3f4b722ac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:29.088402 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e14e12b1-8d01-44cb-82d8-f6b21b75a97a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:29.131550 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e14e12b1-8d01-44cb-82d8-f6b21b75a97a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:29.143525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e14e12b1-8d01-44cb-82d8-f6b21b75a97a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:29.148813 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e14e12b1-8d01-44cb-82d8-f6b21b75a97a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1351 microversion: 2.20 time: 1.007019 Jul 04 09:19:29.152043 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 9/27] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:28 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1351 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:29.189640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-57d6a957-55da-449a-ba89-a3bdbdbbea95 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:29.190521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-57d6a957-55da-449a-ba89-a3bdbdbbea95 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:29.222215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57d6a957-55da-449a-ba89-a3bdbdbbea95 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:29.222696 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57d6a957-55da-449a-ba89-a3bdbdbbea95 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:29.223500 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57d6a957-55da-449a-ba89-a3bdbdbbea95 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:29.223945 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57d6a957-55da-449a-ba89-a3bdbdbbea95 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:29.604259 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e290d78e-0cf1-4706-8dd3-ded3f4b722ac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:29.620037 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e290d78e-0cf1-4706-8dd3-ded3f4b722ac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1310 microversion: 2.1 time: 1.222178 Jul 04 09:19:29.624229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 19/28] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:28 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1310 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:29.992444 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-57d6a957-55da-449a-ba89-a3bdbdbbea95 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:30.010468 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-57d6a957-55da-449a-ba89-a3bdbdbbea95 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1267 microversion: 2.1 time: 0.839179 Jul 04 09:19:30.011069 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 10/29] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:29 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1267 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:30.172929 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3fcdca50-b7e0-4a04-b05f-3299c9b46c09 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:30.174218 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3fcdca50-b7e0-4a04-b05f-3299c9b46c09 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:30.188863 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3fcdca50-b7e0-4a04-b05f-3299c9b46c09 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:30.202243 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3fcdca50-b7e0-4a04-b05f-3299c9b46c09 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:30.203395 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3fcdca50-b7e0-4a04-b05f-3299c9b46c09 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:30.207825 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3fcdca50-b7e0-4a04-b05f-3299c9b46c09 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:30.464031 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3fcdca50-b7e0-4a04-b05f-3299c9b46c09 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:30.477005 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3fcdca50-b7e0-4a04-b05f-3299c9b46c09 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:30.487048 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3fcdca50-b7e0-4a04-b05f-3299c9b46c09 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:30.493010 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3fcdca50-b7e0-4a04-b05f-3299c9b46c09 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1339 microversion: 2.20 time: 0.324947 Jul 04 09:19:30.505469 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 20/30] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:30 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1339 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:30.538150 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1487518865", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20a12957-5ded-4250-8ffa-39871cf9bf25"}], "security_groups": [{"name": "tempest-securitygroup--1788644345"}], "key_name": "tempest-keypair-987467661", "user_data": "}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:30.658126 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-27dc5c2b-ffb0-46b2-b9f4-35b6dc2bbcb1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:30.661275 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-27dc5c2b-ffb0-46b2-b9f4-35b6dc2bbcb1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:30.684101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-27dc5c2b-ffb0-46b2-b9f4-35b6dc2bbcb1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:30.685189 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-27dc5c2b-ffb0-46b2-b9f4-35b6dc2bbcb1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:30.686302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-27dc5c2b-ffb0-46b2-b9f4-35b6dc2bbcb1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:30.687647 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-27dc5c2b-ffb0-46b2-b9f4-35b6dc2bbcb1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:30.866072 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-27dc5c2b-ffb0-46b2-b9f4-35b6dc2bbcb1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:30.869584 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] validate_networks() for [('20a12957-5ded-4250-8ffa-39871cf9bf25', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:19:30.883462 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-27dc5c2b-ffb0-46b2-b9f4-35b6dc2bbcb1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1298 microversion: 2.1 time: 0.239320 Jul 04 09:19:30.884075 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 21/31] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:30 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1298 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:31.035644 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-863a26d2-213c-46e1-9997-fa756c707bd6 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:31.036450 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-863a26d2-213c-46e1-9997-fa756c707bd6 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:31.056896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-863a26d2-213c-46e1-9997-fa756c707bd6 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:31.057822 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-863a26d2-213c-46e1-9997-fa756c707bd6 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:31.061100 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-863a26d2-213c-46e1-9997-fa756c707bd6 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:31.070483 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-863a26d2-213c-46e1-9997-fa756c707bd6 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:31.350671 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-863a26d2-213c-46e1-9997-fa756c707bd6 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:31.364519 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-863a26d2-213c-46e1-9997-fa756c707bd6 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1273 microversion: 2.1 time: 0.340081 Jul 04 09:19:31.365643 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 22/32] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:31 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:31.520364 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-51920215-2c92-48d1-a429-a0f2a3645f38 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:31.521763 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-51920215-2c92-48d1-a429-a0f2a3645f38 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:31.539102 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51920215-2c92-48d1-a429-a0f2a3645f38 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:31.541839 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51920215-2c92-48d1-a429-a0f2a3645f38 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:31.545514 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51920215-2c92-48d1-a429-a0f2a3645f38 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:31.547193 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-51920215-2c92-48d1-a429-a0f2a3645f38 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:31.856118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-51920215-2c92-48d1-a429-a0f2a3645f38 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:31.877133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-51920215-2c92-48d1-a429-a0f2a3645f38 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:31.883719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-51920215-2c92-48d1-a429-a0f2a3645f38 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:31.887736 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-51920215-2c92-48d1-a429-a0f2a3645f38 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1339 microversion: 2.20 time: 0.378765 Jul 04 09:19:31.895397 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 23/33] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:31 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1339 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:31.920180 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-03baa4dd-9297-452a-9bae-3875317dab0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:31.920809 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-03baa4dd-9297-452a-9bae-3875317dab0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:31.948047 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-03baa4dd-9297-452a-9bae-3875317dab0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:31.951677 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-03baa4dd-9297-452a-9bae-3875317dab0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:31.954464 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-03baa4dd-9297-452a-9bae-3875317dab0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:31.955731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-03baa4dd-9297-452a-9bae-3875317dab0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:32.296321 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-03baa4dd-9297-452a-9bae-3875317dab0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:32.333981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-03baa4dd-9297-452a-9bae-3875317dab0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1298 microversion: 2.1 time: 0.436193 Jul 04 09:19:32.337370 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 24/34] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:31 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1298 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:32.392334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f4081ec4-d310-45be-95bf-8327d8b37054 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:32.393312 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f4081ec4-d310-45be-95bf-8327d8b37054 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:32.411640 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4081ec4-d310-45be-95bf-8327d8b37054 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:32.414059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4081ec4-d310-45be-95bf-8327d8b37054 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:32.416061 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4081ec4-d310-45be-95bf-8327d8b37054 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:32.425363 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4081ec4-d310-45be-95bf-8327d8b37054 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:32.970812 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f4081ec4-d310-45be-95bf-8327d8b37054 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:33.012152 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f4081ec4-d310-45be-95bf-8327d8b37054 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1273 microversion: 2.1 time: 0.625400 Jul 04 09:19:33.025459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 25/35] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:32 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1273 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:33.040124 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a9986e4b-1512-4468-ae97-5d21875d4304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:33.041237 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a9986e4b-1512-4468-ae97-5d21875d4304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:33.088360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a9986e4b-1512-4468-ae97-5d21875d4304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:33.089404 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a9986e4b-1512-4468-ae97-5d21875d4304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:33.090702 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a9986e4b-1512-4468-ae97-5d21875d4304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:33.091667 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a9986e4b-1512-4468-ae97-5d21875d4304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:33.247537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:19:33.248158 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:19:33.249154 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:19:33.249894 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:19:33.250598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:19:33.269889 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:33.271128 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:33.276017 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:33.278225 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:33.342197 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Getting quotas for project 123c769553a1424e9c6dba4569bfaea5. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:19:33.356214 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Getting quotas for user e50f9b53a10a43fa9b5fec03d01f451f and project 123c769553a1424e9c6dba4569bfaea5. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:19:33.392756 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:19:33.401642 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:19:33.541394 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8d9f5437-970a-4cf5-acd4-fcfd61a53ff0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.007996 Jul 04 09:19:33.548144 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 11/36] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:19:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 3016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:19:33.557345 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6e0acae5-21d5-4b2d-84f1-b7c49fbd334b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:33.558404 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6e0acae5-21d5-4b2d-84f1-b7c49fbd334b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:33.566874 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6e0acae5-21d5-4b2d-84f1-b7c49fbd334b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:33.568404 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6e0acae5-21d5-4b2d-84f1-b7c49fbd334b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:33.569637 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6e0acae5-21d5-4b2d-84f1-b7c49fbd334b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:33.571382 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6e0acae5-21d5-4b2d-84f1-b7c49fbd334b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:33.938550 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6e0acae5-21d5-4b2d-84f1-b7c49fbd334b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:33.952976 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6e0acae5-21d5-4b2d-84f1-b7c49fbd334b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1298 microversion: 2.1 time: 0.400941 Jul 04 09:19:33.956504 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 12/37] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:33 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1298 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:33.978715 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f1f6b23f-754c-48fb-9557-0c80e6e2f401 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:33.982439 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f1f6b23f-754c-48fb-9557-0c80e6e2f401 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:34.007892 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a9986e4b-1512-4468-ae97-5d21875d4304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:34.032221 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a9986e4b-1512-4468-ae97-5d21875d4304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:34.046146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a9986e4b-1512-4468-ae97-5d21875d4304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:34.048411 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a9986e4b-1512-4468-ae97-5d21875d4304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 1.021230 Jul 04 09:19:34.052742 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 26/38] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:33 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:34.082136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-15b80729-2e86-456d-96db-9cf7c8e71ea3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:34.084158 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-15b80729-2e86-456d-96db-9cf7c8e71ea3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:34.106475 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15b80729-2e86-456d-96db-9cf7c8e71ea3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:34.107155 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15b80729-2e86-456d-96db-9cf7c8e71ea3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:34.108100 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15b80729-2e86-456d-96db-9cf7c8e71ea3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:34.109570 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15b80729-2e86-456d-96db-9cf7c8e71ea3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:34.194865 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:34.346643 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f1f6b23f-754c-48fb-9557-0c80e6e2f401 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:34.400392 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f1f6b23f-754c-48fb-9557-0c80e6e2f401 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1237 microversion: 2.1 time: 0.421941 Jul 04 09:19:34.405138 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 13/39] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:33 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1237 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:34.452955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-15b80729-2e86-456d-96db-9cf7c8e71ea3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:34.467548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-15b80729-2e86-456d-96db-9cf7c8e71ea3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1273 microversion: 2.1 time: 0.401495 Jul 04 09:19:34.468672 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 27/40] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:34 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1273 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:34.972657 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c56b90d8-45eb-4422-a34b-b091a50b341e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:34.973799 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c56b90d8-45eb-4422-a34b-b091a50b341e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:34.987426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c56b90d8-45eb-4422-a34b-b091a50b341e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:34.992064 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c56b90d8-45eb-4422-a34b-b091a50b341e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:35.007223 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c56b90d8-45eb-4422-a34b-b091a50b341e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:35.009299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c56b90d8-45eb-4422-a34b-b091a50b341e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:35.074384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d97a343d-89f5-4a57-bf7a-c058e77bf2dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:35.077500 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d97a343d-89f5-4a57-bf7a-c058e77bf2dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:35.097347 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d97a343d-89f5-4a57-bf7a-c058e77bf2dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:35.099889 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d97a343d-89f5-4a57-bf7a-c058e77bf2dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:35.100382 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d97a343d-89f5-4a57-bf7a-c058e77bf2dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:35.103086 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d97a343d-89f5-4a57-bf7a-c058e77bf2dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:35.490149 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c56b90d8-45eb-4422-a34b-b091a50b341e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:35.501306 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c56b90d8-45eb-4422-a34b-b091a50b341e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.533345 Jul 04 09:19:35.502653 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 14/41] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:34 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:35.513297 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9ee41191-171c-4b16-bb30-20d53ed7117f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:35.514396 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9ee41191-171c-4b16-bb30-20d53ed7117f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:35.544046 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ee41191-171c-4b16-bb30-20d53ed7117f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:35.545544 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ee41191-171c-4b16-bb30-20d53ed7117f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:35.548706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ee41191-171c-4b16-bb30-20d53ed7117f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:35.552397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ee41191-171c-4b16-bb30-20d53ed7117f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:35.625596 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d97a343d-89f5-4a57-bf7a-c058e77bf2dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:35.635547 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d97a343d-89f5-4a57-bf7a-c058e77bf2dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:35.637774 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d97a343d-89f5-4a57-bf7a-c058e77bf2dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:35.639427 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d97a343d-89f5-4a57-bf7a-c058e77bf2dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.573046 Jul 04 09:19:35.640645 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 28/42] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:35 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:35.661764 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ab1c1979-fd97-4c41-88da-96ea66663eb0 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:35.662702 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ab1c1979-fd97-4c41-88da-96ea66663eb0 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:35.671702 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab1c1979-fd97-4c41-88da-96ea66663eb0 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:35.672716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab1c1979-fd97-4c41-88da-96ea66663eb0 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:35.673914 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab1c1979-fd97-4c41-88da-96ea66663eb0 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:35.674485 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab1c1979-fd97-4c41-88da-96ea66663eb0 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:35.767960 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9ee41191-171c-4b16-bb30-20d53ed7117f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:35.785483 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9ee41191-171c-4b16-bb30-20d53ed7117f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1289 microversion: 2.1 time: 0.278916 Jul 04 09:19:35.790325 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 15/43] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:35 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1289 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:36.139017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ab1c1979-fd97-4c41-88da-96ea66663eb0 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:36.157462 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ab1c1979-fd97-4c41-88da-96ea66663eb0 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.509733 Jul 04 09:19:36.167184 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 29/44] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:35 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:36.524994 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7b50da1c-940b-48f4-bdf4-bf66c9834e47 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:36.525834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7b50da1c-940b-48f4-bdf4-bf66c9834e47 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:36.539675 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7b50da1c-940b-48f4-bdf4-bf66c9834e47 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:36.542144 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7b50da1c-940b-48f4-bdf4-bf66c9834e47 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:36.546716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7b50da1c-940b-48f4-bdf4-bf66c9834e47 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:36.547405 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7b50da1c-940b-48f4-bdf4-bf66c9834e47 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:36.659958 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-178da02b-3aae-4b17-898c-192b7ca80290 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:36.660852 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-178da02b-3aae-4b17-898c-192b7ca80290 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:36.669927 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-178da02b-3aae-4b17-898c-192b7ca80290 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:36.670365 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-178da02b-3aae-4b17-898c-192b7ca80290 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:36.672631 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-178da02b-3aae-4b17-898c-192b7ca80290 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:36.674981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-178da02b-3aae-4b17-898c-192b7ca80290 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:36.922826 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7b50da1c-940b-48f4-bdf4-bf66c9834e47 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:36.942031 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7b50da1c-940b-48f4-bdf4-bf66c9834e47 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.424300 Jul 04 09:19:36.943349 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 16/45] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:36 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:36.948839 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ab093187-72d1-44a1-984f-f0f079ea5eb0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:36.949507 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ab093187-72d1-44a1-984f-f0f079ea5eb0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:36.961572 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab093187-72d1-44a1-984f-f0f079ea5eb0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:36.963870 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab093187-72d1-44a1-984f-f0f079ea5eb0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:36.970647 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab093187-72d1-44a1-984f-f0f079ea5eb0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:36.971389 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab093187-72d1-44a1-984f-f0f079ea5eb0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:37.004165 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-178da02b-3aae-4b17-898c-192b7ca80290 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:37.015560 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-178da02b-3aae-4b17-898c-192b7ca80290 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:37.018131 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-178da02b-3aae-4b17-898c-192b7ca80290 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:37.019511 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-178da02b-3aae-4b17-898c-192b7ca80290 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.363555 Jul 04 09:19:37.021020 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 30/46] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:36 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:37.080429 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ab093187-72d1-44a1-984f-f0f079ea5eb0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:37.099646 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ab093187-72d1-44a1-984f-f0f079ea5eb0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1295 microversion: 2.1 time: 0.155216 Jul 04 09:19:37.110046 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 17/47] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:36 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1295 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:37.180992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8019440e-1ae1-4416-94de-1950f0d40a61 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:37.182341 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8019440e-1ae1-4416-94de-1950f0d40a61 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:37.190336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8019440e-1ae1-4416-94de-1950f0d40a61 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:37.191532 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8019440e-1ae1-4416-94de-1950f0d40a61 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:37.193175 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8019440e-1ae1-4416-94de-1950f0d40a61 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:37.194452 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8019440e-1ae1-4416-94de-1950f0d40a61 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:37.549989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8019440e-1ae1-4416-94de-1950f0d40a61 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:37.564468 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8019440e-1ae1-4416-94de-1950f0d40a61 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.395089 Jul 04 09:19:37.574284 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 31/48] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:37 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:37.961696 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0871561f-f3dc-47a9-ae87-0a8076069f14 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:37.962361 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0871561f-f3dc-47a9-ae87-0a8076069f14 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:37.990338 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0871561f-f3dc-47a9-ae87-0a8076069f14 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:37.991015 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0871561f-f3dc-47a9-ae87-0a8076069f14 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:37.992595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0871561f-f3dc-47a9-ae87-0a8076069f14 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:37.992897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0871561f-f3dc-47a9-ae87-0a8076069f14 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:38.039504 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-469bf00c-c171-4e87-934c-6c68007a80f4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:38.040136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-469bf00c-c171-4e87-934c-6c68007a80f4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:38.050883 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-469bf00c-c171-4e87-934c-6c68007a80f4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:38.053295 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-469bf00c-c171-4e87-934c-6c68007a80f4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:38.056586 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-469bf00c-c171-4e87-934c-6c68007a80f4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:38.060024 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-469bf00c-c171-4e87-934c-6c68007a80f4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:38.142331 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=20 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:38.532569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0871561f-f3dc-47a9-ae87-0a8076069f14 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:38.546808 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0871561f-f3dc-47a9-ae87-0a8076069f14 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.590863 Jul 04 09:19:38.551112 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 18/49] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:37 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:38.566296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-63db903e-9056-4d2a-8fbd-0c9bbdce0c61 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:38.567514 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-63db903e-9056-4d2a-8fbd-0c9bbdce0c61 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:38.594176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-63db903e-9056-4d2a-8fbd-0c9bbdce0c61 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:38.597553 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-63db903e-9056-4d2a-8fbd-0c9bbdce0c61 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:38.599756 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-63db903e-9056-4d2a-8fbd-0c9bbdce0c61 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:38.603824 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-63db903e-9056-4d2a-8fbd-0c9bbdce0c61 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:38.642364 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-469bf00c-c171-4e87-934c-6c68007a80f4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:38.669072 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-469bf00c-c171-4e87-934c-6c68007a80f4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:38.672741 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-469bf00c-c171-4e87-934c-6c68007a80f4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:38.675161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-469bf00c-c171-4e87-934c-6c68007a80f4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.640558 Jul 04 09:19:38.678821 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 32/50] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:38 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:38.688049 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f13ad070-82ac-45a7-b848-281c11a75cbb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:38.688963 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f13ad070-82ac-45a7-b848-281c11a75cbb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:38.724725 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f13ad070-82ac-45a7-b848-281c11a75cbb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:38.726940 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f13ad070-82ac-45a7-b848-281c11a75cbb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:38.729292 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f13ad070-82ac-45a7-b848-281c11a75cbb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:38.730438 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f13ad070-82ac-45a7-b848-281c11a75cbb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:38.749436 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:38.771479 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-63db903e-9056-4d2a-8fbd-0c9bbdce0c61 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:38.797181 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-63db903e-9056-4d2a-8fbd-0c9bbdce0c61 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1295 microversion: 2.1 time: 0.243637 Jul 04 09:19:38.797417 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 19/51] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:38 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1295 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:39.243791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f13ad070-82ac-45a7-b848-281c11a75cbb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:39.259006 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f13ad070-82ac-45a7-b848-281c11a75cbb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.570879 Jul 04 09:19:39.260876 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 33/52] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:38 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:39.568127 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e945ea38-8587-4930-ba69-ab82349bf1fa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:39.568630 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e945ea38-8587-4930-ba69-ab82349bf1fa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:39.580510 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e945ea38-8587-4930-ba69-ab82349bf1fa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:39.580975 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e945ea38-8587-4930-ba69-ab82349bf1fa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:39.586377 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e945ea38-8587-4930-ba69-ab82349bf1fa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:39.587983 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e945ea38-8587-4930-ba69-ab82349bf1fa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:39.699406 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2d2b559d-d057-427b-ad27-a4f3630d6665 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:39.700030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2d2b559d-d057-427b-ad27-a4f3630d6665 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:39.710240 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2d2b559d-d057-427b-ad27-a4f3630d6665 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:39.715993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2d2b559d-d057-427b-ad27-a4f3630d6665 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:39.720189 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2d2b559d-d057-427b-ad27-a4f3630d6665 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:39.722850 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2d2b559d-d057-427b-ad27-a4f3630d6665 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.171805 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e945ea38-8587-4930-ba69-ab82349bf1fa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:40.191016 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e945ea38-8587-4930-ba69-ab82349bf1fa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.625432 Jul 04 09:19:40.195974 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 20/53] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:39 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:40.215122 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-27f35773-d1e9-4f32-8244-5936650a12cc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:40.219682 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-27f35773-d1e9-4f32-8244-5936650a12cc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:40.254306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2d2b559d-d057-427b-ad27-a4f3630d6665 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:40.259621 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27f35773-d1e9-4f32-8244-5936650a12cc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.260304 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27f35773-d1e9-4f32-8244-5936650a12cc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.261950 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27f35773-d1e9-4f32-8244-5936650a12cc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.264037 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27f35773-d1e9-4f32-8244-5936650a12cc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.265988 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2d2b559d-d057-427b-ad27-a4f3630d6665 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:40.274870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2d2b559d-d057-427b-ad27-a4f3630d6665 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:40.276423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2d2b559d-d057-427b-ad27-a4f3630d6665 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.583360 Jul 04 09:19:40.278351 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 34/54] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:39 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:40.295012 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-61e6de91-b718-49f0-9eb9-6239768074b3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:40.295893 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-61e6de91-b718-49f0-9eb9-6239768074b3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:40.303600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-61e6de91-b718-49f0-9eb9-6239768074b3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.312711 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-61e6de91-b718-49f0-9eb9-6239768074b3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.314006 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-61e6de91-b718-49f0-9eb9-6239768074b3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:40.314670 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-61e6de91-b718-49f0-9eb9-6239768074b3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:40.572167 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-27f35773-d1e9-4f32-8244-5936650a12cc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:40.590875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-27f35773-d1e9-4f32-8244-5936650a12cc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1295 microversion: 2.1 time: 0.391523 Jul 04 09:19:40.601679 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 21/55] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:40 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1295 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:40.674603 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-61e6de91-b718-49f0-9eb9-6239768074b3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:40.684604 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-61e6de91-b718-49f0-9eb9-6239768074b3 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.403588 Jul 04 09:19:40.686345 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 35/56] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:40 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:41.212554 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9f2a2740-0a61-49c9-bfac-b2bb97612b8c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:41.213299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9f2a2740-0a61-49c9-bfac-b2bb97612b8c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:41.257339 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f2a2740-0a61-49c9-bfac-b2bb97612b8c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:41.258179 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f2a2740-0a61-49c9-bfac-b2bb97612b8c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:41.259106 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f2a2740-0a61-49c9-bfac-b2bb97612b8c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:41.259595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f2a2740-0a61-49c9-bfac-b2bb97612b8c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:41.299317 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7482264e-6d0a-4e70-8d95-ec24a77c68fe tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:41.301744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7482264e-6d0a-4e70-8d95-ec24a77c68fe tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:41.321296 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7482264e-6d0a-4e70-8d95-ec24a77c68fe tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:41.327385 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7482264e-6d0a-4e70-8d95-ec24a77c68fe tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:41.328809 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7482264e-6d0a-4e70-8d95-ec24a77c68fe tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:41.334142 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7482264e-6d0a-4e70-8d95-ec24a77c68fe tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:41.902698 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9f2a2740-0a61-49c9-bfac-b2bb97612b8c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:41.915172 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9f2a2740-0a61-49c9-bfac-b2bb97612b8c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.706987 Jul 04 09:19:41.928017 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 22/57] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:41 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:41.940732 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7482264e-6d0a-4e70-8d95-ec24a77c68fe tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:41.968558 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7482264e-6d0a-4e70-8d95-ec24a77c68fe tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:41.977177 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a8c9243b-66b3-4b67-8523-76d5efe64670 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:41.978046 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a8c9243b-66b3-4b67-8523-76d5efe64670 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:41.986004 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7482264e-6d0a-4e70-8d95-ec24a77c68fe tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:41.993186 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7482264e-6d0a-4e70-8d95-ec24a77c68fe tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.696126 Jul 04 09:19:42.001137 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 36/58] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:41 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:19:42.026521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8c9243b-66b3-4b67-8523-76d5efe64670 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.028330 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8c9243b-66b3-4b67-8523-76d5efe64670 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.029969 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8c9243b-66b3-4b67-8523-76d5efe64670 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.032226 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8c9243b-66b3-4b67-8523-76d5efe64670 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.036914 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fca1d4a5-3428-4ed2-ac55-4e152236ec17 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:42.041563 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fca1d4a5-3428-4ed2-ac55-4e152236ec17 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:42.058746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fca1d4a5-3428-4ed2-ac55-4e152236ec17 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.059486 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fca1d4a5-3428-4ed2-ac55-4e152236ec17 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.064691 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fca1d4a5-3428-4ed2-ac55-4e152236ec17 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.065547 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fca1d4a5-3428-4ed2-ac55-4e152236ec17 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.336401 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fca1d4a5-3428-4ed2-ac55-4e152236ec17 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:42.350670 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fca1d4a5-3428-4ed2-ac55-4e152236ec17 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.331280 Jul 04 09:19:42.352886 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 37/59] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:42 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:42.404288 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a8c9243b-66b3-4b67-8523-76d5efe64670 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:42.420532 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a8c9243b-66b3-4b67-8523-76d5efe64670 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1363 microversion: 2.1 time: 0.483842 Jul 04 09:19:42.431595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 23/60] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:41 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:42.474706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-a1fbd7f9-ac93-46e0-8af4-5fb206092100 req-f09fee8c-a9df-4952-8217-79bc2e080b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8dcc08-23ef-46ee-b941-55a7f1716d41", "tag": "170feb05-63b9-496e-b589-498558ed153c"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:42.490690 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-a1fbd7f9-ac93-46e0-8af4-5fb206092100 req-f09fee8c-a9df-4952-8217-79bc2e080b09 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.491124 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-a1fbd7f9-ac93-46e0-8af4-5fb206092100 req-f09fee8c-a9df-4952-8217-79bc2e080b09 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.513431 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-a1fbd7f9-ac93-46e0-8af4-5fb206092100 req-f09fee8c-a9df-4952-8217-79bc2e080b09 service nova] Creating event network-changed:170feb05-63b9-496e-b589-498558ed153c for instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 on hv-cinder-84456 Jul 04 09:19:42.519894 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-a1fbd7f9-ac93-46e0-8af4-5fb206092100 req-f09fee8c-a9df-4952-8217-79bc2e080b09 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117664) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 09:19:42.519894 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f7c202f-f36a-4ebc-8102-f9094cf30407 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.519894 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f7c202f-f36a-4ebc-8102-f9094cf30407 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.519894 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f7c202f-f36a-4ebc-8102-f9094cf30407 None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.519894 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f7c202f-f36a-4ebc-8102-f9094cf30407 None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.530045 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.compute.rpcapi [None req-8f7c202f-f36a-4ebc-8102-f9094cf30407 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 09:19:42.530955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8f7c202f-f36a-4ebc-8102-f9094cf30407 None None] Releasing lock "compute-rpcapi-router" {{(pid=117664) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 09:19:42.547648 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8f7c202f-f36a-4ebc-8102-f9094cf30407 None None] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190553 Jul 04 09:19:42.548691 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 38/61] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:42.949791 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-91d9cbe1-014a-4557-b45e-5aae6d821a99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:42.952059 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-91d9cbe1-014a-4557-b45e-5aae6d821a99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:42.959483 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-91d9cbe1-014a-4557-b45e-5aae6d821a99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.960363 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-91d9cbe1-014a-4557-b45e-5aae6d821a99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:42.961989 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-91d9cbe1-014a-4557-b45e-5aae6d821a99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:42.962733 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-91d9cbe1-014a-4557-b45e-5aae6d821a99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.021002 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff2e3861-e247-41ab-b275-fef6ffc532d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:43.021923 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff2e3861-e247-41ab-b275-fef6ffc532d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:43.030620 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:43.033473 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff2e3861-e247-41ab-b275-fef6ffc532d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.034161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff2e3861-e247-41ab-b275-fef6ffc532d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.035013 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff2e3861-e247-41ab-b275-fef6ffc532d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.035581 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff2e3861-e247-41ab-b275-fef6ffc532d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.310559 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:43.451866 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-91d9cbe1-014a-4557-b45e-5aae6d821a99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:43.480598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-91d9cbe1-014a-4557-b45e-5aae6d821a99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.536241 Jul 04 09:19:43.484328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 24/62] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:42 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:43.491158 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ba2582df-13bb-4a7e-8807-0c869d88a13e tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:43.495240 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ba2582df-13bb-4a7e-8807-0c869d88a13e tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:43.529645 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff2e3861-e247-41ab-b275-fef6ffc532d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:43.541869 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff2e3861-e247-41ab-b275-fef6ffc532d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:43.546477 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff2e3861-e247-41ab-b275-fef6ffc532d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:43.551884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff2e3861-e247-41ab-b275-fef6ffc532d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.533815 Jul 04 09:19:43.552961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba2582df-13bb-4a7e-8807-0c869d88a13e tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.553183 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba2582df-13bb-4a7e-8807-0c869d88a13e tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.554041 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba2582df-13bb-4a7e-8807-0c869d88a13e tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.554569 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 39/63] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:43 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:19:43.558105 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ba2582df-13bb-4a7e-8807-0c869d88a13e tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.565591 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4c6253ed-6dcf-4720-9202-bd6aa5eb0255 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:43.566414 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4c6253ed-6dcf-4720-9202-bd6aa5eb0255 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:43.580284 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c6253ed-6dcf-4720-9202-bd6aa5eb0255 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.580740 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c6253ed-6dcf-4720-9202-bd6aa5eb0255 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:43.581564 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c6253ed-6dcf-4720-9202-bd6aa5eb0255 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:43.582001 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4c6253ed-6dcf-4720-9202-bd6aa5eb0255 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.057691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ba2582df-13bb-4a7e-8807-0c869d88a13e tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:44.068358 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ba2582df-13bb-4a7e-8807-0c869d88a13e tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.582699 Jul 04 09:19:44.070943 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 25/64] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:43 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:44.077110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4c6253ed-6dcf-4720-9202-bd6aa5eb0255 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:44.097649 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4c6253ed-6dcf-4720-9202-bd6aa5eb0255 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1363 microversion: 2.1 time: 0.540210 Jul 04 09:19:44.102543 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 40/65] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:43 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1363 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:44.501072 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1238db18-ece8-46d7-bdc5-e08ef3177369 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:44.501962 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1238db18-ece8-46d7-bdc5-e08ef3177369 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:44.511072 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=24 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:44.514059 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:44.517261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1238db18-ece8-46d7-bdc5-e08ef3177369 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.520304 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1238db18-ece8-46d7-bdc5-e08ef3177369 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.521888 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1238db18-ece8-46d7-bdc5-e08ef3177369 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.524734 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1238db18-ece8-46d7-bdc5-e08ef3177369 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.557371 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:44.581984 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-37da0223-38b2-41f8-9dbf-6c77bdda3524 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:44.582609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-37da0223-38b2-41f8-9dbf-6c77bdda3524 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:44.593803 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37da0223-38b2-41f8-9dbf-6c77bdda3524 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.594159 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37da0223-38b2-41f8-9dbf-6c77bdda3524 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.596685 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37da0223-38b2-41f8-9dbf-6c77bdda3524 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.597333 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37da0223-38b2-41f8-9dbf-6c77bdda3524 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.758639 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1238db18-ece8-46d7-bdc5-e08ef3177369 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:44.773235 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1238db18-ece8-46d7-bdc5-e08ef3177369 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.276676 Jul 04 09:19:44.784651 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 26/66] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:44 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:44.786660 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-27371799-20de-4b86-876f-b2430ee7e56d req-baeb8090-6471-469e-a396-68a0c74d4ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df7890f-b2e1-476d-a951-8ad28d7ff91b", "tag": "da60ee33-ffff-4869-9c04-6546c43a8492"}, {"name": "network-changed", "server_uuid": "e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9", "tag": "269b875a-fb77-473d-945b-1f69f949824f"}, {"name": "network-changed", "server_uuid": "0f72ca5c-5b7b-4f0f-9e77-e3279a898c25", "tag": "7fc49830-0d78-454c-a8f0-695acad83764"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:44.806738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-27371799-20de-4b86-876f-b2430ee7e56d req-baeb8090-6471-469e-a396-68a0c74d4ed4 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.807364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-27371799-20de-4b86-876f-b2430ee7e56d req-baeb8090-6471-469e-a396-68a0c74d4ed4 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.836772 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-37da0223-38b2-41f8-9dbf-6c77bdda3524 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:44.848222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-27371799-20de-4b86-876f-b2430ee7e56d req-baeb8090-6471-469e-a396-68a0c74d4ed4 service nova] Creating event network-changed:da60ee33-ffff-4869-9c04-6546c43a8492 for instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b on hv-cinder-84456 Jul 04 09:19:44.849474 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-27371799-20de-4b86-876f-b2430ee7e56d req-baeb8090-6471-469e-a396-68a0c74d4ed4 service nova] Creating event network-changed:269b875a-fb77-473d-945b-1f69f949824f for instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 on hv-cinder-84456 Jul 04 09:19:44.850953 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-27371799-20de-4b86-876f-b2430ee7e56d req-baeb8090-6471-469e-a396-68a0c74d4ed4 service nova] Creating event network-changed:7fc49830-0d78-454c-a8f0-695acad83764 for instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 on hv-cinder-84456 Jul 04 09:19:44.852291 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-27371799-20de-4b86-876f-b2430ee7e56d req-baeb8090-6471-469e-a396-68a0c74d4ed4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117665) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 09:19:44.854123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57ab2087-9cc6-4105-9ce7-c1fecf375702 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.854921 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57ab2087-9cc6-4105-9ce7-c1fecf375702 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.856088 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57ab2087-9cc6-4105-9ce7-c1fecf375702 None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:44.857218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57ab2087-9cc6-4105-9ce7-c1fecf375702 None None] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:44.861471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-37da0223-38b2-41f8-9dbf-6c77bdda3524 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:44.868733 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.compute.rpcapi [None req-57ab2087-9cc6-4105-9ce7-c1fecf375702 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 09:19:44.869092 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-37da0223-38b2-41f8-9dbf-6c77bdda3524 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:44.870273 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57ab2087-9cc6-4105-9ce7-c1fecf375702 None None] Releasing lock "compute-rpcapi-router" {{(pid=117665) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 09:19:44.873339 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-37da0223-38b2-41f8-9dbf-6c77bdda3524 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.304278 Jul 04 09:19:44.873951 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 41/67] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:44 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:44.900765 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-57ab2087-9cc6-4105-9ce7-c1fecf375702 None None] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.121183 Jul 04 09:19:44.901909 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 27/68] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:45.089958 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e04f9cca-170b-4654-a23a-540430070095 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:45.094057 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e04f9cca-170b-4654-a23a-540430070095 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:45.106937 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e04f9cca-170b-4654-a23a-540430070095 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.107884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e04f9cca-170b-4654-a23a-540430070095 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.109305 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e04f9cca-170b-4654-a23a-540430070095 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.109956 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e04f9cca-170b-4654-a23a-540430070095 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.120599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-04b8b186-0755-46af-8900-a80b2be66ec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:45.121412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-04b8b186-0755-46af-8900-a80b2be66ec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:45.133723 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04b8b186-0755-46af-8900-a80b2be66ec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.134252 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04b8b186-0755-46af-8900-a80b2be66ec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.138022 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04b8b186-0755-46af-8900-a80b2be66ec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.138553 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04b8b186-0755-46af-8900-a80b2be66ec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.472150 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e04f9cca-170b-4654-a23a-540430070095 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:45.484996 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e04f9cca-170b-4654-a23a-540430070095 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.400071 Jul 04 09:19:45.488848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 42/69] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:45 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:45.497724 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-04b8b186-0755-46af-8900-a80b2be66ec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:45.541668 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-04b8b186-0755-46af-8900-a80b2be66ec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1363 microversion: 2.1 time: 0.425725 Jul 04 09:19:45.542327 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 28/70] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:45 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:45.792577 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-05c3d0c6-857d-4c0b-860d-9beaf77e6fbb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:45.793295 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-05c3d0c6-857d-4c0b-860d-9beaf77e6fbb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:45.809136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05c3d0c6-857d-4c0b-860d-9beaf77e6fbb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.809609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05c3d0c6-857d-4c0b-860d-9beaf77e6fbb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.810703 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05c3d0c6-857d-4c0b-860d-9beaf77e6fbb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.811320 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05c3d0c6-857d-4c0b-860d-9beaf77e6fbb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.894397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-268b0ef6-de3b-4ef4-a0cf-eef6d77b9830 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:45.894397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-268b0ef6-de3b-4ef4-a0cf-eef6d77b9830 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:45.902447 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-268b0ef6-de3b-4ef4-a0cf-eef6d77b9830 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.904252 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-268b0ef6-de3b-4ef4-a0cf-eef6d77b9830 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:45.905365 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-268b0ef6-de3b-4ef4-a0cf-eef6d77b9830 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:45.909576 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-268b0ef6-de3b-4ef4-a0cf-eef6d77b9830 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.125189 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-05c3d0c6-857d-4c0b-860d-9beaf77e6fbb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:46.139165 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-05c3d0c6-857d-4c0b-860d-9beaf77e6fbb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.351280 Jul 04 09:19:46.152127 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 43/71] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:45 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:46.183924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-268b0ef6-de3b-4ef4-a0cf-eef6d77b9830 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:46.200661 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-268b0ef6-de3b-4ef4-a0cf-eef6d77b9830 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:46.200661 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-268b0ef6-de3b-4ef4-a0cf-eef6d77b9830 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:46.200661 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-268b0ef6-de3b-4ef4-a0cf-eef6d77b9830 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.311872 Jul 04 09:19:46.210881 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 29/72] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:45 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:46.503717 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e4d65b13-52fd-4708-849c-64eba4a2e9f7 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:46.505274 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e4d65b13-52fd-4708-849c-64eba4a2e9f7 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:46.514252 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4d65b13-52fd-4708-849c-64eba4a2e9f7 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.515316 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4d65b13-52fd-4708-849c-64eba4a2e9f7 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.516578 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4d65b13-52fd-4708-849c-64eba4a2e9f7 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.517220 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4d65b13-52fd-4708-849c-64eba4a2e9f7 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.563182 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ea836491-4ecd-4bd5-86e9-b6dd32621446 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:46.564027 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ea836491-4ecd-4bd5-86e9-b6dd32621446 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:46.579010 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ea836491-4ecd-4bd5-86e9-b6dd32621446 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.579503 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ea836491-4ecd-4bd5-86e9-b6dd32621446 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.580297 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ea836491-4ecd-4bd5-86e9-b6dd32621446 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:46.580735 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ea836491-4ecd-4bd5-86e9-b6dd32621446 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:46.733422 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e4d65b13-52fd-4708-849c-64eba4a2e9f7 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:46.746637 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e4d65b13-52fd-4708-849c-64eba4a2e9f7 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.246961 Jul 04 09:19:46.749652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 44/73] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:46 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:46.812450 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ea836491-4ecd-4bd5-86e9-b6dd32621446 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:46.820772 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ea836491-4ecd-4bd5-86e9-b6dd32621446 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1363 microversion: 2.1 time: 0.264898 Jul 04 09:19:46.821905 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 30/74] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:46 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:47.178270 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8a218161-e1de-4965-af0b-69ff85d163dd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:47.178270 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8a218161-e1de-4965-af0b-69ff85d163dd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:47.195512 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a218161-e1de-4965-af0b-69ff85d163dd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.196116 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a218161-e1de-4965-af0b-69ff85d163dd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.196915 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a218161-e1de-4965-af0b-69ff85d163dd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.197424 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a218161-e1de-4965-af0b-69ff85d163dd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.218557 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-280abdb9-556c-4fb1-a635-a88989d0294d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:47.219175 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-280abdb9-556c-4fb1-a635-a88989d0294d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:47.232336 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-280abdb9-556c-4fb1-a635-a88989d0294d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.233787 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-280abdb9-556c-4fb1-a635-a88989d0294d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.234792 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-280abdb9-556c-4fb1-a635-a88989d0294d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.238653 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-280abdb9-556c-4fb1-a635-a88989d0294d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.518721 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-280abdb9-556c-4fb1-a635-a88989d0294d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:47.538161 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-280abdb9-556c-4fb1-a635-a88989d0294d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:47.543625 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-280abdb9-556c-4fb1-a635-a88989d0294d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:47.545729 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-280abdb9-556c-4fb1-a635-a88989d0294d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.332369 Jul 04 09:19:47.552866 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 31/75] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:47 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:19:47.567820 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8a218161-e1de-4965-af0b-69ff85d163dd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:47.577746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8a218161-e1de-4965-af0b-69ff85d163dd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.422770 Jul 04 09:19:47.586397 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 45/76] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:47 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:47.767487 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f00cb795-4df2-4bac-be07-413316d0616d tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:47.768452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f00cb795-4df2-4bac-be07-413316d0616d tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:47.776013 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f00cb795-4df2-4bac-be07-413316d0616d tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.776741 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f00cb795-4df2-4bac-be07-413316d0616d tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.777747 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f00cb795-4df2-4bac-be07-413316d0616d tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.778487 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f00cb795-4df2-4bac-be07-413316d0616d tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.839721 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fb1a0587-5374-4058-ba5e-aa9f64ab1836 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:47.840343 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fb1a0587-5374-4058-ba5e-aa9f64ab1836 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:47.853471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb1a0587-5374-4058-ba5e-aa9f64ab1836 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.855942 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb1a0587-5374-4058-ba5e-aa9f64ab1836 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:47.857877 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb1a0587-5374-4058-ba5e-aa9f64ab1836 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:47.859665 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb1a0587-5374-4058-ba5e-aa9f64ab1836 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.077647 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f00cb795-4df2-4bac-be07-413316d0616d tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:48.090052 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f00cb795-4df2-4bac-be07-413316d0616d tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.326229 Jul 04 09:19:48.097528 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 32/77] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:47 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:48.227654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fb1a0587-5374-4058-ba5e-aa9f64ab1836 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:48.241305 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fb1a0587-5374-4058-ba5e-aa9f64ab1836 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1363 microversion: 2.1 time: 0.406405 Jul 04 09:19:48.251966 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 46/78] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:47 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:48.575717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9574cecf-8a13-4d72-8a1c-0dcdf37e3d0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:48.576606 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9574cecf-8a13-4d72-8a1c-0dcdf37e3d0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:48.584455 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9574cecf-8a13-4d72-8a1c-0dcdf37e3d0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.584922 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9574cecf-8a13-4d72-8a1c-0dcdf37e3d0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.587476 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9574cecf-8a13-4d72-8a1c-0dcdf37e3d0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.588051 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9574cecf-8a13-4d72-8a1c-0dcdf37e3d0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.597772 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-abdcf3c6-a052-44dd-87a6-e40bd572ec77 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:48.598722 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-abdcf3c6-a052-44dd-87a6-e40bd572ec77 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:48.607981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-abdcf3c6-a052-44dd-87a6-e40bd572ec77 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.610922 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-abdcf3c6-a052-44dd-87a6-e40bd572ec77 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.613241 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-abdcf3c6-a052-44dd-87a6-e40bd572ec77 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:48.619338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-abdcf3c6-a052-44dd-87a6-e40bd572ec77 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:48.897451 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9574cecf-8a13-4d72-8a1c-0dcdf37e3d0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:48.920395 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-abdcf3c6-a052-44dd-87a6-e40bd572ec77 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:48.926933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9574cecf-8a13-4d72-8a1c-0dcdf37e3d0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:48.938013 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9574cecf-8a13-4d72-8a1c-0dcdf37e3d0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:48.939071 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9574cecf-8a13-4d72-8a1c-0dcdf37e3d0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.367445 Jul 04 09:19:48.939620 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 33/79] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:48 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:48.952243 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-abdcf3c6-a052-44dd-87a6-e40bd572ec77 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.357711 Jul 04 09:19:48.952243 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 47/80] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:48 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:49.109528 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-78e6940b-7481-4d49-b14a-6f907f28db88 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:49.110367 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-78e6940b-7481-4d49-b14a-6f907f28db88 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:49.134593 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-78e6940b-7481-4d49-b14a-6f907f28db88 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:49.135269 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-78e6940b-7481-4d49-b14a-6f907f28db88 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:49.136353 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-78e6940b-7481-4d49-b14a-6f907f28db88 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:49.138338 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-78e6940b-7481-4d49-b14a-6f907f28db88 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:49.260708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-06aafcf6-c362-4854-bfa9-364c4d25b76c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:49.261380 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-06aafcf6-c362-4854-bfa9-364c4d25b76c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:49.274706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06aafcf6-c362-4854-bfa9-364c4d25b76c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:49.277493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06aafcf6-c362-4854-bfa9-364c4d25b76c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:49.280552 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06aafcf6-c362-4854-bfa9-364c4d25b76c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:49.281027 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-06aafcf6-c362-4854-bfa9-364c4d25b76c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:49.498870 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-78e6940b-7481-4d49-b14a-6f907f28db88 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:49.506856 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-78e6940b-7481-4d49-b14a-6f907f28db88 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.403319 Jul 04 09:19:49.511972 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 34/81] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:49 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:49.561790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-06aafcf6-c362-4854-bfa9-364c4d25b76c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:49.571400 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-06aafcf6-c362-4854-bfa9-364c4d25b76c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1363 microversion: 2.1 time: 0.315073 Jul 04 09:19:49.580270 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 48/82] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:49 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:49.959531 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7f8a5078-b1e7-4bb1-8f1d-21f21c000544 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:49.961462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7f8a5078-b1e7-4bb1-8f1d-21f21c000544 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:49.971105 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ca2b8fee-5a9c-4dd7-adcf-fe5a34e420f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:49.972148 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ca2b8fee-5a9c-4dd7-adcf-fe5a34e420f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:49.999200 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f8a5078-b1e7-4bb1-8f1d-21f21c000544 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.001004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f8a5078-b1e7-4bb1-8f1d-21f21c000544 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.001583 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ca2b8fee-5a9c-4dd7-adcf-fe5a34e420f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.003511 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ca2b8fee-5a9c-4dd7-adcf-fe5a34e420f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.004620 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f8a5078-b1e7-4bb1-8f1d-21f21c000544 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.007932 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ca2b8fee-5a9c-4dd7-adcf-fe5a34e420f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.008909 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f8a5078-b1e7-4bb1-8f1d-21f21c000544 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.009618 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ca2b8fee-5a9c-4dd7-adcf-fe5a34e420f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.292179 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ca2b8fee-5a9c-4dd7-adcf-fe5a34e420f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:50.309943 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ca2b8fee-5a9c-4dd7-adcf-fe5a34e420f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.343857 Jul 04 09:19:50.310582 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 49/83] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:49 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:50.641464 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7f8a5078-b1e7-4bb1-8f1d-21f21c000544 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:50.655706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7f8a5078-b1e7-4bb1-8f1d-21f21c000544 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:50.655811 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7f8a5078-b1e7-4bb1-8f1d-21f21c000544 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:50.656899 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7f8a5078-b1e7-4bb1-8f1d-21f21c000544 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.703959 Jul 04 09:19:50.658518 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 35/84] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:49 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:50.683055 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-9e20904a-4189-487c-a3bc-83d23e1e597a req-6e256650-84aa-45ba-b8e8-468eaf60b54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df7890f-b2e1-476d-a951-8ad28d7ff91b", "name": "network-vif-plugged", "status": "completed", "tag": "da60ee33-ffff-4869-9c04-6546c43a8492"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:50.690823 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-61f98ef2-01df-4d2e-a0f2-7ef7a0e3d6aa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:50.692824 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-61f98ef2-01df-4d2e-a0f2-7ef7a0e3d6aa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:50.698968 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-9e20904a-4189-487c-a3bc-83d23e1e597a req-6e256650-84aa-45ba-b8e8-468eaf60b54e service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.699422 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-9e20904a-4189-487c-a3bc-83d23e1e597a req-6e256650-84aa-45ba-b8e8-468eaf60b54e service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.706912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-61f98ef2-01df-4d2e-a0f2-7ef7a0e3d6aa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.708641 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-61f98ef2-01df-4d2e-a0f2-7ef7a0e3d6aa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.710515 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:50.710760 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-61f98ef2-01df-4d2e-a0f2-7ef7a0e3d6aa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.711226 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-61f98ef2-01df-4d2e-a0f2-7ef7a0e3d6aa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.733628 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-9e20904a-4189-487c-a3bc-83d23e1e597a req-6e256650-84aa-45ba-b8e8-468eaf60b54e service nova] Creating event network-vif-plugged:da60ee33-ffff-4869-9c04-6546c43a8492 for instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b on hv-cinder-84456 Jul 04 09:19:50.742396 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-9e20904a-4189-487c-a3bc-83d23e1e597a req-6e256650-84aa-45ba-b8e8-468eaf60b54e service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333353 Jul 04 09:19:50.745718 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 50/85] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:50.751901 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a4341597-1b0e-49af-bf25-0e368ad94d38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:50.752930 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a4341597-1b0e-49af-bf25-0e368ad94d38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:50.760367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4341597-1b0e-49af-bf25-0e368ad94d38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.761110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4341597-1b0e-49af-bf25-0e368ad94d38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:50.762053 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4341597-1b0e-49af-bf25-0e368ad94d38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:50.762642 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4341597-1b0e-49af-bf25-0e368ad94d38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.061522 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-61f98ef2-01df-4d2e-a0f2-7ef7a0e3d6aa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:51.062242 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a4341597-1b0e-49af-bf25-0e368ad94d38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:51.073084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a4341597-1b0e-49af-bf25-0e368ad94d38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1363 microversion: 2.1 time: 0.324276 Jul 04 09:19:51.074989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 51/86] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:50 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:51.088150 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-61f98ef2-01df-4d2e-a0f2-7ef7a0e3d6aa tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.422537 Jul 04 09:19:51.092035 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 36/87] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:50 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:51.329114 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-02bf7d9c-4374-4654-948a-5460879a7b5c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:51.330542 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-02bf7d9c-4374-4654-948a-5460879a7b5c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:51.349258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02bf7d9c-4374-4654-948a-5460879a7b5c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.349796 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02bf7d9c-4374-4654-948a-5460879a7b5c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.351161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02bf7d9c-4374-4654-948a-5460879a7b5c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.356219 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02bf7d9c-4374-4654-948a-5460879a7b5c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.678157 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0c8fddb6-dd1a-4610-92db-d70e4fd58d1f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:51.679450 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0c8fddb6-dd1a-4610-92db-d70e4fd58d1f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:51.691130 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-02bf7d9c-4374-4654-948a-5460879a7b5c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:51.691791 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c8fddb6-dd1a-4610-92db-d70e4fd58d1f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.693391 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c8fddb6-dd1a-4610-92db-d70e4fd58d1f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.694203 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c8fddb6-dd1a-4610-92db-d70e4fd58d1f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:51.700059 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c8fddb6-dd1a-4610-92db-d70e4fd58d1f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:51.700762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-02bf7d9c-4374-4654-948a-5460879a7b5c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.378205 Jul 04 09:19:51.701498 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 52/88] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:51 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:51.924664 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0c8fddb6-dd1a-4610-92db-d70e4fd58d1f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:51.935699 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0c8fddb6-dd1a-4610-92db-d70e4fd58d1f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:51.937768 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0c8fddb6-dd1a-4610-92db-d70e4fd58d1f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:51.939815 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0c8fddb6-dd1a-4610-92db-d70e4fd58d1f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.268008 Jul 04 09:19:51.941237 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 37/89] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:51 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:52.094399 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9ad7acdf-b597-4b92-81ae-9d7e5895ba73 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:52.095376 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9ad7acdf-b597-4b92-81ae-9d7e5895ba73 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:52.111846 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b3ab3223-7ae3-4cc4-987e-bcce3834d51b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:52.112739 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b3ab3223-7ae3-4cc4-987e-bcce3834d51b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:52.124383 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3ab3223-7ae3-4cc4-987e-bcce3834d51b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.126147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ad7acdf-b597-4b92-81ae-9d7e5895ba73 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.126903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ad7acdf-b597-4b92-81ae-9d7e5895ba73 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.128228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ad7acdf-b597-4b92-81ae-9d7e5895ba73 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.128996 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ad7acdf-b597-4b92-81ae-9d7e5895ba73 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.129816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3ab3223-7ae3-4cc4-987e-bcce3834d51b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.132850 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3ab3223-7ae3-4cc4-987e-bcce3834d51b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.136650 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3ab3223-7ae3-4cc4-987e-bcce3834d51b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.529131 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9ad7acdf-b597-4b92-81ae-9d7e5895ba73 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:52.531747 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:52.549271 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9ad7acdf-b597-4b92-81ae-9d7e5895ba73 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1363 microversion: 2.1 time: 0.458361 Jul 04 09:19:52.549891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 53/90] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:52 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1363 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:52.590702 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b3ab3223-7ae3-4cc4-987e-bcce3834d51b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:52.604926 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b3ab3223-7ae3-4cc4-987e-bcce3834d51b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.496906 Jul 04 09:19:52.606033 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 38/91] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:52 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:52.719315 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e4b904db-8a71-4927-8828-b81ecae7e771 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:52.719921 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e4b904db-8a71-4927-8828-b81ecae7e771 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:52.728500 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4b904db-8a71-4927-8828-b81ecae7e771 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.728961 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4b904db-8a71-4927-8828-b81ecae7e771 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.730077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4b904db-8a71-4927-8828-b81ecae7e771 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.730511 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e4b904db-8a71-4927-8828-b81ecae7e771 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.931497 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e4b904db-8a71-4927-8828-b81ecae7e771 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:52.941000 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e4b904db-8a71-4927-8828-b81ecae7e771 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1365 microversion: 2.1 time: 0.226238 Jul 04 09:19:52.942542 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 54/92] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:52 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:52.958215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fa1e838d-cfe3-4045-95d4-f7187d0be834 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:52.958826 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fa1e838d-cfe3-4045-95d4-f7187d0be834 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:52.968639 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa1e838d-cfe3-4045-95d4-f7187d0be834 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.968639 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa1e838d-cfe3-4045-95d4-f7187d0be834 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:52.969424 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa1e838d-cfe3-4045-95d4-f7187d0be834 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:52.970024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa1e838d-cfe3-4045-95d4-f7187d0be834 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.143517 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa1e838d-cfe3-4045-95d4-f7187d0be834 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:53.157765 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa1e838d-cfe3-4045-95d4-f7187d0be834 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:53.160782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa1e838d-cfe3-4045-95d4-f7187d0be834 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:53.164102 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fa1e838d-cfe3-4045-95d4-f7187d0be834 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.209657 Jul 04 09:19:53.164666 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 39/93] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:52 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:53.567140 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bb29f40a-8361-44d9-810e-a1f8b324f5d9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:53.567876 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bb29f40a-8361-44d9-810e-a1f8b324f5d9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:53.575680 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb29f40a-8361-44d9-810e-a1f8b324f5d9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.576447 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb29f40a-8361-44d9-810e-a1f8b324f5d9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.577506 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb29f40a-8361-44d9-810e-a1f8b324f5d9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.578156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb29f40a-8361-44d9-810e-a1f8b324f5d9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.583550 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-5c2ec2f4-b993-4b92-b216-e4d87a51aeaf req-c9da09f7-33de-4523-99a7-52071d8e1f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f72ca5c-5b7b-4f0f-9e77-e3279a898c25", "name": "network-vif-plugged", "status": "completed", "tag": "7fc49830-0d78-454c-a8f0-695acad83764"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:53.596969 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-5c2ec2f4-b993-4b92-b216-e4d87a51aeaf req-c9da09f7-33de-4523-99a7-52071d8e1f43 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.597761 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-5c2ec2f4-b993-4b92-b216-e4d87a51aeaf req-c9da09f7-33de-4523-99a7-52071d8e1f43 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.611528 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-5c2ec2f4-b993-4b92-b216-e4d87a51aeaf req-c9da09f7-33de-4523-99a7-52071d8e1f43 service nova] Creating event network-vif-plugged:7fc49830-0d78-454c-a8f0-695acad83764 for instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 on hv-cinder-84456 Jul 04 09:19:53.619468 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-5c2ec2f4-b993-4b92-b216-e4d87a51aeaf req-c9da09f7-33de-4523-99a7-52071d8e1f43 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043836 Jul 04 09:19:53.620218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 40/94] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:19:53.626819 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-53d96b5f-fe40-4016-8ca6-ed41f41c36bb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:53.628046 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-53d96b5f-fe40-4016-8ca6-ed41f41c36bb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:53.636691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d96b5f-fe40-4016-8ca6-ed41f41c36bb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.639140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d96b5f-fe40-4016-8ca6-ed41f41c36bb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.640107 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d96b5f-fe40-4016-8ca6-ed41f41c36bb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.641023 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d96b5f-fe40-4016-8ca6-ed41f41c36bb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.847169 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bb29f40a-8361-44d9-810e-a1f8b324f5d9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:53.870874 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bb29f40a-8361-44d9-810e-a1f8b324f5d9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1363 microversion: 2.1 time: 0.294703 Jul 04 09:19:53.873280 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 55/95] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:53 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:53.960418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1b0bc29c-0697-4639-9e35-80db11044e9f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:53.961412 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1b0bc29c-0697-4639-9e35-80db11044e9f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:53.971321 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1b0bc29c-0697-4639-9e35-80db11044e9f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.976659 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1b0bc29c-0697-4639-9e35-80db11044e9f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:53.977872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1b0bc29c-0697-4639-9e35-80db11044e9f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:53.978536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1b0bc29c-0697-4639-9e35-80db11044e9f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.002444 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-53d96b5f-fe40-4016-8ca6-ed41f41c36bb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:54.014321 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-53d96b5f-fe40-4016-8ca6-ed41f41c36bb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.392763 Jul 04 09:19:54.024437 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 41/96] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:53 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:54.183712 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2bd6cca3-77ba-4f87-a41c-93f5c4fee356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:54.184370 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2bd6cca3-77ba-4f87-a41c-93f5c4fee356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:54.196404 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2bd6cca3-77ba-4f87-a41c-93f5c4fee356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.196881 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2bd6cca3-77ba-4f87-a41c-93f5c4fee356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.198142 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2bd6cca3-77ba-4f87-a41c-93f5c4fee356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.201151 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2bd6cca3-77ba-4f87-a41c-93f5c4fee356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.515460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1b0bc29c-0697-4639-9e35-80db11044e9f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:54.518405 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2bd6cca3-77ba-4f87-a41c-93f5c4fee356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:54.526266 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1b0bc29c-0697-4639-9e35-80db11044e9f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1555 microversion: 2.1 time: 0.570112 Jul 04 09:19:54.527226 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 56/97] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:53 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1555 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:54.527353 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2bd6cca3-77ba-4f87-a41c-93f5c4fee356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:54.528834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2bd6cca3-77ba-4f87-a41c-93f5c4fee356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:54.530222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2bd6cca3-77ba-4f87-a41c-93f5c4fee356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.352071 Jul 04 09:19:54.541192 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 42/98] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:54 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:54.545361 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-030c43e5-9a36-47b1-90b4-4bd3f2a4c5e0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:54.545997 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-030c43e5-9a36-47b1-90b4-4bd3f2a4c5e0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:54.552507 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-030c43e5-9a36-47b1-90b4-4bd3f2a4c5e0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.553062 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-030c43e5-9a36-47b1-90b4-4bd3f2a4c5e0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.553959 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-030c43e5-9a36-47b1-90b4-4bd3f2a4c5e0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.554608 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-030c43e5-9a36-47b1-90b4-4bd3f2a4c5e0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.693984 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-030c43e5-9a36-47b1-90b4-4bd3f2a4c5e0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.152908 Jul 04 09:19:54.702010 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 57/99] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 4 09:19:54 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:54.889576 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-35e8f2c6-9f6a-44bc-8c8e-5aa75cb83662 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:54.890517 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-35e8f2c6-9f6a-44bc-8c8e-5aa75cb83662 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:54.892711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:54.911663 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35e8f2c6-9f6a-44bc-8c8e-5aa75cb83662 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.912114 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35e8f2c6-9f6a-44bc-8c8e-5aa75cb83662 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:54.913429 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35e8f2c6-9f6a-44bc-8c8e-5aa75cb83662 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:54.919989 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35e8f2c6-9f6a-44bc-8c8e-5aa75cb83662 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.040770 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-08c544c4-6cda-4137-b04f-a85a93a2ec3c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:55.041652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-08c544c4-6cda-4137-b04f-a85a93a2ec3c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:55.056088 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08c544c4-6cda-4137-b04f-a85a93a2ec3c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:55.058473 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08c544c4-6cda-4137-b04f-a85a93a2ec3c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.059476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08c544c4-6cda-4137-b04f-a85a93a2ec3c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:55.062951 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-08c544c4-6cda-4137-b04f-a85a93a2ec3c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.185458 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-35e8f2c6-9f6a-44bc-8c8e-5aa75cb83662 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:55.196026 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-35e8f2c6-9f6a-44bc-8c8e-5aa75cb83662 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1363 microversion: 2.1 time: 0.310709 Jul 04 09:19:55.197627 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 43/100] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:54 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:55.363293 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-08c544c4-6cda-4137-b04f-a85a93a2ec3c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:55.379330 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-08c544c4-6cda-4137-b04f-a85a93a2ec3c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.345321 Jul 04 09:19:55.379924 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 58/101] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:55 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:55.548766 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-32dfdf6d-12c5-4b8c-8ac3-a33bde9f2954 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:55.549415 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-32dfdf6d-12c5-4b8c-8ac3-a33bde9f2954 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:55.566048 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-32dfdf6d-12c5-4b8c-8ac3-a33bde9f2954 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:55.566535 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-32dfdf6d-12c5-4b8c-8ac3-a33bde9f2954 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.567280 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-32dfdf6d-12c5-4b8c-8ac3-a33bde9f2954 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:55.567718 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-32dfdf6d-12c5-4b8c-8ac3-a33bde9f2954 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.572844 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:19:55.710544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-d3d99145-2a1e-4294-88fc-905585b8bdbb req-a73ada76-970d-4dcd-8079-8a32ed23a0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9", "name": "network-vif-plugged", "status": "completed", "tag": "269b875a-fb77-473d-945b-1f69f949824f"}, {"server_uuid": "9a8dcc08-23ef-46ee-b941-55a7f1716d41", "name": "network-vif-plugged", "status": "completed", "tag": "170feb05-63b9-496e-b589-498558ed153c"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:55.727965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-d3d99145-2a1e-4294-88fc-905585b8bdbb req-a73ada76-970d-4dcd-8079-8a32ed23a0a4 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:55.730384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-d3d99145-2a1e-4294-88fc-905585b8bdbb req-a73ada76-970d-4dcd-8079-8a32ed23a0a4 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:55.751871 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-d3d99145-2a1e-4294-88fc-905585b8bdbb req-a73ada76-970d-4dcd-8079-8a32ed23a0a4 service nova] Creating event network-vif-plugged:269b875a-fb77-473d-945b-1f69f949824f for instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 on hv-cinder-84456 Jul 04 09:19:55.756431 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-d3d99145-2a1e-4294-88fc-905585b8bdbb req-a73ada76-970d-4dcd-8079-8a32ed23a0a4 service nova] Creating event network-vif-plugged:170feb05-63b9-496e-b589-498558ed153c for instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 on hv-cinder-84456 Jul 04 09:19:55.773436 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-d3d99145-2a1e-4294-88fc-905585b8bdbb req-a73ada76-970d-4dcd-8079-8a32ed23a0a4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066921 Jul 04 09:19:55.774468 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 59/102] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:55.957438 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-32dfdf6d-12c5-4b8c-8ac3-a33bde9f2954 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:55.972454 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-32dfdf6d-12c5-4b8c-8ac3-a33bde9f2954 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:55.974006 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-32dfdf6d-12c5-4b8c-8ac3-a33bde9f2954 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:55.987703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-32dfdf6d-12c5-4b8c-8ac3-a33bde9f2954 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.440449 Jul 04 09:19:55.988988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 44/103] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:55 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:56.216998 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d8772c4c-73e6-45de-8dd2-ce603f541003 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:56.217819 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d8772c4c-73e6-45de-8dd2-ce603f541003 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:56.230761 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d8772c4c-73e6-45de-8dd2-ce603f541003 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.231708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d8772c4c-73e6-45de-8dd2-ce603f541003 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.233530 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d8772c4c-73e6-45de-8dd2-ce603f541003 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.234185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d8772c4c-73e6-45de-8dd2-ce603f541003 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.403350 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a5bed7fa-20d9-47d4-8845-0530d73abd22 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:56.404822 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a5bed7fa-20d9-47d4-8845-0530d73abd22 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:56.414011 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5bed7fa-20d9-47d4-8845-0530d73abd22 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.415989 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5bed7fa-20d9-47d4-8845-0530d73abd22 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.417285 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5bed7fa-20d9-47d4-8845-0530d73abd22 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.418036 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5bed7fa-20d9-47d4-8845-0530d73abd22 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.542307 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d8772c4c-73e6-45de-8dd2-ce603f541003 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:56.550449 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d8772c4c-73e6-45de-8dd2-ce603f541003 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1550 microversion: 2.1 time: 0.340443 Jul 04 09:19:56.551199 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 60/104] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:56 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1550 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:56.571710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a39eb002-c158-4c5c-8a74-be71eb9cb2cb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:56.572327 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a39eb002-c158-4c5c-8a74-be71eb9cb2cb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:56.584917 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a39eb002-c158-4c5c-8a74-be71eb9cb2cb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.586653 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a39eb002-c158-4c5c-8a74-be71eb9cb2cb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.587484 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a39eb002-c158-4c5c-8a74-be71eb9cb2cb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:56.590607 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a39eb002-c158-4c5c-8a74-be71eb9cb2cb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:56.768977 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a39eb002-c158-4c5c-8a74-be71eb9cb2cb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203150 Jul 04 09:19:56.776119 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 61/105] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 4 09:19:56 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:56.822902 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a5bed7fa-20d9-47d4-8845-0530d73abd22 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:56.836567 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a5bed7fa-20d9-47d4-8845-0530d73abd22 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.437945 Jul 04 09:19:56.837943 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 45/106] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:56 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:19:57.006460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a6f544d4-6dba-4dce-922b-8c7341390370 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:57.007224 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a6f544d4-6dba-4dce-922b-8c7341390370 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:57.027002 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6f544d4-6dba-4dce-922b-8c7341390370 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.027462 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6f544d4-6dba-4dce-922b-8c7341390370 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.028246 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6f544d4-6dba-4dce-922b-8c7341390370 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.028679 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a6f544d4-6dba-4dce-922b-8c7341390370 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.216240 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-9374a2f9-8a0c-4e37-999d-cfdaba5cf04b req-2d2aff5b-a0ac-4809-8199-cc4ae361848c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df7890f-b2e1-476d-a951-8ad28d7ff91b", "tag": "da60ee33-ffff-4869-9c04-6546c43a8492"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:57.224734 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-9374a2f9-8a0c-4e37-999d-cfdaba5cf04b req-2d2aff5b-a0ac-4809-8199-cc4ae361848c service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.227894 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-9374a2f9-8a0c-4e37-999d-cfdaba5cf04b req-2d2aff5b-a0ac-4809-8199-cc4ae361848c service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.258872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-9374a2f9-8a0c-4e37-999d-cfdaba5cf04b req-2d2aff5b-a0ac-4809-8199-cc4ae361848c service nova] Creating event network-changed:da60ee33-ffff-4869-9c04-6546c43a8492 for instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b on hv-cinder-84456 Jul 04 09:19:57.270822 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-9374a2f9-8a0c-4e37-999d-cfdaba5cf04b req-2d2aff5b-a0ac-4809-8199-cc4ae361848c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059034 Jul 04 09:19:57.271907 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 46/107] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:57.275461 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a6f544d4-6dba-4dce-922b-8c7341390370 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:57.287099 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a6f544d4-6dba-4dce-922b-8c7341390370 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:57.290848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a6f544d4-6dba-4dce-922b-8c7341390370 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:57.293888 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a6f544d4-6dba-4dce-922b-8c7341390370 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1407 microversion: 2.20 time: 0.290422 Jul 04 09:19:57.295555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 62/108] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:57 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:19:57.854281 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c4077f39-29e8-49f5-abc5-23ea4b1a68cf tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:57.855537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c4077f39-29e8-49f5-abc5-23ea4b1a68cf tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:57.864595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c4077f39-29e8-49f5-abc5-23ea4b1a68cf tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.869977 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c4077f39-29e8-49f5-abc5-23ea4b1a68cf tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:57.871806 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c4077f39-29e8-49f5-abc5-23ea4b1a68cf tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:57.872412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c4077f39-29e8-49f5-abc5-23ea4b1a68cf tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.314762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bf22a762-54b3-46b4-8eb3-3b32e4047491 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:58.315442 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bf22a762-54b3-46b4-8eb3-3b32e4047491 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:58.334727 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bf22a762-54b3-46b4-8eb3-3b32e4047491 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.335652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bf22a762-54b3-46b4-8eb3-3b32e4047491 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.339966 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bf22a762-54b3-46b4-8eb3-3b32e4047491 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.341463 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bf22a762-54b3-46b4-8eb3-3b32e4047491 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.371004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c4077f39-29e8-49f5-abc5-23ea4b1a68cf tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:58.390546 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c4077f39-29e8-49f5-abc5-23ea4b1a68cf tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1315 microversion: 2.1 time: 0.540925 Jul 04 09:19:58.401838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 47/109] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:57 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:19:58.614472 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bf22a762-54b3-46b4-8eb3-3b32e4047491 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:58.629609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bf22a762-54b3-46b4-8eb3-3b32e4047491 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:58.631665 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bf22a762-54b3-46b4-8eb3-3b32e4047491 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:19:58.633230 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bf22a762-54b3-46b4-8eb3-3b32e4047491 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1599 microversion: 2.20 time: 0.323831 Jul 04 09:19:58.634132 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 63/110] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:19:58 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1599 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:19:58.655993 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5e61440a-2b67-47e7-bac7-f0b6c5ea258b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:58.656763 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5e61440a-2b67-47e7-bac7-f0b6c5ea258b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:58.666093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5e61440a-2b67-47e7-bac7-f0b6c5ea258b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.667070 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5e61440a-2b67-47e7-bac7-f0b6c5ea258b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.668299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5e61440a-2b67-47e7-bac7-f0b6c5ea258b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:58.668968 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5e61440a-2b67-47e7-bac7-f0b6c5ea258b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:58.957995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5e61440a-2b67-47e7-bac7-f0b6c5ea258b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.305911 Jul 04 09:19:58.959614 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 48/111] 10.222.0.71 () {60 vars in 1315 bytes} [Mon Jul 4 09:19:58 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-interface => generated 284 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:19:59.328716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-520bafe1-35e5-444b-8475-3b62436d4840 req-b20946d7-41ca-428c-aaf2-a3df1b4cb761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f72ca5c-5b7b-4f0f-9e77-e3279a898c25", "tag": "7fc49830-0d78-454c-a8f0-695acad83764"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:19:59.347158 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-520bafe1-35e5-444b-8475-3b62436d4840 req-b20946d7-41ca-428c-aaf2-a3df1b4cb761 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:59.347720 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-520bafe1-35e5-444b-8475-3b62436d4840 req-b20946d7-41ca-428c-aaf2-a3df1b4cb761 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:59.362708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-520bafe1-35e5-444b-8475-3b62436d4840 req-b20946d7-41ca-428c-aaf2-a3df1b4cb761 service nova] Creating event network-changed:7fc49830-0d78-454c-a8f0-695acad83764 for instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 on hv-cinder-84456 Jul 04 09:19:59.380956 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-520bafe1-35e5-444b-8475-3b62436d4840 req-b20946d7-41ca-428c-aaf2-a3df1b4cb761 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055692 Jul 04 09:19:59.381729 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 64/112] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:19:59.411650 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5b6bad22-b0bc-4c7d-a36d-68b5c8d1c02f tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:19:59.412279 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5b6bad22-b0bc-4c7d-a36d-68b5c8d1c02f tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:19:59.432165 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b6bad22-b0bc-4c7d-a36d-68b5c8d1c02f tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:59.434640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b6bad22-b0bc-4c7d-a36d-68b5c8d1c02f tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:19:59.436488 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b6bad22-b0bc-4c7d-a36d-68b5c8d1c02f tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:19:59.438883 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b6bad22-b0bc-4c7d-a36d-68b5c8d1c02f tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:00.120288 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5b6bad22-b0bc-4c7d-a36d-68b5c8d1c02f tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:00.131570 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5b6bad22-b0bc-4c7d-a36d-68b5c8d1c02f tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1502 microversion: 2.1 time: 0.723088 Jul 04 09:20:00.133206 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 49/113] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:19:59 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1502 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:01.811452 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-121bf723-6afb-4443-8b89-660a9d7af29c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21e79d59-ac13-4fe9-a164-45477b8123df"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:01.812781 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-121bf723-6afb-4443-8b89-660a9d7af29c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:01.824313 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-121bf723-6afb-4443-8b89-660a9d7af29c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:01.832354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-121bf723-6afb-4443-8b89-660a9d7af29c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:01.833405 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-121bf723-6afb-4443-8b89-660a9d7af29c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:01.834043 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-121bf723-6afb-4443-8b89-660a9d7af29c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:02.297583 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-121bf723-6afb-4443-8b89-660a9d7af29c tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "POST /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490262 Jul 04 09:20:02.303147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 65/114] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:20:01 2022] POST /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:02.530952 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-028831ab-6217-4221-ad2e-8fd26c8b1e21 req-ffcf8b76-5c19-48f3-91a1-f2c8188ebb2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8dcc08-23ef-46ee-b941-55a7f1716d41", "tag": "170feb05-63b9-496e-b589-498558ed153c"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:02.544372 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-028831ab-6217-4221-ad2e-8fd26c8b1e21 req-ffcf8b76-5c19-48f3-91a1-f2c8188ebb2a service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:02.551207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-028831ab-6217-4221-ad2e-8fd26c8b1e21 req-ffcf8b76-5c19-48f3-91a1-f2c8188ebb2a service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:02.581431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-028831ab-6217-4221-ad2e-8fd26c8b1e21 req-ffcf8b76-5c19-48f3-91a1-f2c8188ebb2a service nova] Creating event network-changed:170feb05-63b9-496e-b589-498558ed153c for instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 on hv-cinder-84456 Jul 04 09:20:02.593595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-028831ab-6217-4221-ad2e-8fd26c8b1e21 req-ffcf8b76-5c19-48f3-91a1-f2c8188ebb2a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218068 Jul 04 09:20:02.594761 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 50/115] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:14.368230 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=53 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:14.370491 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:14.391323 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7c1aa3dd-e03e-4a4b-9955-a20494c620da tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:14.393074 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7c1aa3dd-e03e-4a4b-9955-a20494c620da tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:14.431181 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c1aa3dd-e03e-4a4b-9955-a20494c620da tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:14.431756 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c1aa3dd-e03e-4a4b-9955-a20494c620da tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:14.436203 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c1aa3dd-e03e-4a4b-9955-a20494c620da tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:14.437948 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c1aa3dd-e03e-4a4b-9955-a20494c620da tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:14.482787 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7c1aa3dd-e03e-4a4b-9955-a20494c620da tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:20:14.597197 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7c1aa3dd-e03e-4a4b-9955-a20494c620da tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 204 len: 0 microversion: 2.1 time: 0.230664 Jul 04 09:20:14.597834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 66/116] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:20:14 2022] DELETE /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:20:14.607413 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f79c4161-30a4-4832-a15b-0e9a6944b9a1 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:14.609226 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f79c4161-30a4-4832-a15b-0e9a6944b9a1 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:14.613280 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=48 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:14.613930 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=30 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:14.619476 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f79c4161-30a4-4832-a15b-0e9a6944b9a1 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:14.619938 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f79c4161-30a4-4832-a15b-0e9a6944b9a1 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:14.620716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f79c4161-30a4-4832-a15b-0e9a6944b9a1 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:14.621188 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f79c4161-30a4-4832-a15b-0e9a6944b9a1 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:14.755364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f79c4161-30a4-4832-a15b-0e9a6944b9a1 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:14.764695 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f79c4161-30a4-4832-a15b-0e9a6944b9a1 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1554 microversion: 2.1 time: 0.162237 Jul 04 09:20:14.765288 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 51/117] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:14 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:15.782374 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-14612808-1cb6-4fb4-b774-301c470ff77b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:15.783141 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-14612808-1cb6-4fb4-b774-301c470ff77b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:15.789650 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14612808-1cb6-4fb4-b774-301c470ff77b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:15.790223 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14612808-1cb6-4fb4-b774-301c470ff77b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:15.790992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14612808-1cb6-4fb4-b774-301c470ff77b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:15.791525 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14612808-1cb6-4fb4-b774-301c470ff77b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:15.931120 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-14612808-1cb6-4fb4-b774-301c470ff77b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:15.939935 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-14612808-1cb6-4fb4-b774-301c470ff77b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1554 microversion: 2.1 time: 0.161988 Jul 04 09:20:15.940580 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 67/118] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:15 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:16.957401 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-67bd7073-4cc2-46a3-a005-43e83c3432e4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:16.958024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-67bd7073-4cc2-46a3-a005-43e83c3432e4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:16.965267 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-67bd7073-4cc2-46a3-a005-43e83c3432e4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:16.965726 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-67bd7073-4cc2-46a3-a005-43e83c3432e4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:16.966498 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-67bd7073-4cc2-46a3-a005-43e83c3432e4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:16.966940 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-67bd7073-4cc2-46a3-a005-43e83c3432e4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:17.096059 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-67bd7073-4cc2-46a3-a005-43e83c3432e4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:17.104844 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-67bd7073-4cc2-46a3-a005-43e83c3432e4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1554 microversion: 2.1 time: 0.151351 Jul 04 09:20:17.105439 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 52/119] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:16 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:18.122735 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-aba6f56a-1682-414d-bb18-606043ff30ac tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:18.123388 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-aba6f56a-1682-414d-bb18-606043ff30ac tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:18.130061 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aba6f56a-1682-414d-bb18-606043ff30ac tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:18.130511 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aba6f56a-1682-414d-bb18-606043ff30ac tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:18.131275 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aba6f56a-1682-414d-bb18-606043ff30ac tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:18.131711 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aba6f56a-1682-414d-bb18-606043ff30ac tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:18.259977 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-aba6f56a-1682-414d-bb18-606043ff30ac tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:18.267849 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-aba6f56a-1682-414d-bb18-606043ff30ac tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1554 microversion: 2.1 time: 0.148988 Jul 04 09:20:18.268406 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 68/120] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:18 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:19.284781 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1e14c74a-afe7-4989-ac08-63aac191e55b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:19.285426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1e14c74a-afe7-4989-ac08-63aac191e55b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:19.291487 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e14c74a-afe7-4989-ac08-63aac191e55b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:19.291933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e14c74a-afe7-4989-ac08-63aac191e55b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:19.292691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e14c74a-afe7-4989-ac08-63aac191e55b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:19.293156 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e14c74a-afe7-4989-ac08-63aac191e55b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:19.424841 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1e14c74a-afe7-4989-ac08-63aac191e55b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:19.434149 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1e14c74a-afe7-4989-ac08-63aac191e55b tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1554 microversion: 2.1 time: 0.153152 Jul 04 09:20:19.434722 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 53/121] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:19 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:20.451737 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-01381cf3-7934-4717-acd6-77c15a87a1ad tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:20.452354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-01381cf3-7934-4717-acd6-77c15a87a1ad tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:20.459032 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-01381cf3-7934-4717-acd6-77c15a87a1ad tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:20.459488 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-01381cf3-7934-4717-acd6-77c15a87a1ad tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:20.460296 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-01381cf3-7934-4717-acd6-77c15a87a1ad tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:20.460769 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-01381cf3-7934-4717-acd6-77c15a87a1ad tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:20.526423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-01381cf3-7934-4717-acd6-77c15a87a1ad tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e034114ab8244cc99dbf977b458a43f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acebc31809343e0abdc39ee5a127961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:20.537947 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-01381cf3-7934-4717-acd6-77c15a87a1ad tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 200 len: 1512 microversion: 2.1 time: 0.090062 Jul 04 09:20:20.538379 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 69/122] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:20 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 1512 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:20.595069 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-9f6cec75-01d8-456e-a94a-f6a2db02e7e0 req-1b1dae87-2aa8-4691-a7b0-99c235336e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9", "name": "network-vif-deleted", "tag": "269b875a-fb77-473d-945b-1f69f949824f"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:20.605084 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-9f6cec75-01d8-456e-a94a-f6a2db02e7e0 req-1b1dae87-2aa8-4691-a7b0-99c235336e5d service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:20.605788 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-9f6cec75-01d8-456e-a94a-f6a2db02e7e0 req-1b1dae87-2aa8-4691-a7b0-99c235336e5d service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:20.618725 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-9f6cec75-01d8-456e-a94a-f6a2db02e7e0 req-1b1dae87-2aa8-4691-a7b0-99c235336e5d service nova] Creating event network-vif-deleted:269b875a-fb77-473d-945b-1f69f949824f for instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 on hv-cinder-84456 Jul 04 09:20:20.624564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-9f6cec75-01d8-456e-a94a-f6a2db02e7e0 req-1b1dae87-2aa8-4691-a7b0-99c235336e5d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033273 Jul 04 09:20:20.625820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 54/123] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:21.556136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c3ccc851-5805-48a8-ab0f-814c9324afcb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:21.556762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c3ccc851-5805-48a8-ab0f-814c9324afcb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:21.563529 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3ccc851-5805-48a8-ab0f-814c9324afcb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:21.564015 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3ccc851-5805-48a8-ab0f-814c9324afcb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:21.564766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3ccc851-5805-48a8-ab0f-814c9324afcb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:21.565243 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3ccc851-5805-48a8-ab0f-814c9324afcb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:21.581423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-c3ccc851-5805-48a8-ab0f-814c9324afcb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] HTTP exception thrown: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c3ccc851-5805-48a8-ab0f-814c9324afcb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Request method failure captured: Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 HTTP/1.1 Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCa8aoDq91QBTASQJMWlQ8nFWNPg6BamB8hWwu-nzYM8HH_kQtjKUqr-3lF3OFSp9OYEvzXNa5HedDgXWDgQy3bOzn9G1OnObFp3kRS7Iif4tECzcBk0nH-clIjbYYa8U8Sm70WidWf8rcA8nRzwzutrR6NfeSWJ3VuRiJwB_nLo2I Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 9acebc31809343e0abdc39ee5a127961 Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:20:21.592367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9acebc31809343e0abdc39ee5a127961", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 9acebc31809343e0abdc39ee5a127961 Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-DeleteServersTestJSON-880599112-project Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: e034114ab8244cc99dbf977b458a43f9 Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-DeleteServersTestJSON-880599112-project Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:21.593636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9'} Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:20:21.594798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:21.596357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:20:21.598474 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c3ccc851-5805-48a8-ab0f-814c9324afcb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Returning 404 to user: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:20:21.598474 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c3ccc851-5805-48a8-ab0f-814c9324afcb tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 404 len: 111 microversion: 2.1 time: 0.042979 Jul 04 09:20:21.598474 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 70/124] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:21 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:20:21.843610 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6dcc69da-e691-413f-a33c-c41e5c9cb16a tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:21.844737 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6dcc69da-e691-413f-a33c-c41e5c9cb16a tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:21.851389 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6dcc69da-e691-413f-a33c-c41e5c9cb16a tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:21.852578 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6dcc69da-e691-413f-a33c-c41e5c9cb16a tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:21.853492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6dcc69da-e691-413f-a33c-c41e5c9cb16a tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:21.854107 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6dcc69da-e691-413f-a33c-c41e5c9cb16a tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:21.870703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-6dcc69da-e691-413f-a33c-c41e5c9cb16a tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] HTTP exception thrown: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6dcc69da-e691-413f-a33c-c41e5c9cb16a tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Request method failure captured: Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9/os-volume_attachments HTTP/1.1 Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCa8aoDq91QBTASQJMWlQ8nFWNPg6BamB8hWwu-nzYM8HH_kQtjKUqr-3lF3OFSp9OYEvzXNa5HedDgXWDgQy3bOzn9G1OnObFp3kRS7Iif4tECzcBk0nH-clIjbYYa8U8Sm70WidWf8rcA8nRzwzutrR6NfeSWJ3VuRiJwB_nLo2I Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 9acebc31809343e0abdc39ee5a127961 Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:20:21.875002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9acebc31809343e0abdc39ee5a127961", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 9acebc31809343e0abdc39ee5a127961 Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-DeleteServersTestJSON-880599112-project Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: e034114ab8244cc99dbf977b458a43f9 Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-DeleteServersTestJSON-880599112-project Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:21.876262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'server_id': 'e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9'} Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:20:21.876906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:21.877982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:20:21.879041 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6dcc69da-e691-413f-a33c-c41e5c9cb16a tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Returning 404 to user: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:20:21.879041 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6dcc69da-e691-413f-a33c-c41e5c9cb16a tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037503 Jul 04 09:20:21.879041 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 55/125] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:20:21 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:20:23.075952 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cdbcd1a8-e54a-47be-8d9e-8fa0ff2048b4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:23.077368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cdbcd1a8-e54a-47be-8d9e-8fa0ff2048b4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:23.084516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdbcd1a8-e54a-47be-8d9e-8fa0ff2048b4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:23.085382 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdbcd1a8-e54a-47be-8d9e-8fa0ff2048b4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:23.086768 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdbcd1a8-e54a-47be-8d9e-8fa0ff2048b4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:23.087418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdbcd1a8-e54a-47be-8d9e-8fa0ff2048b4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:23.103387 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-cdbcd1a8-e54a-47be-8d9e-8fa0ff2048b4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] HTTP exception thrown: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cdbcd1a8-e54a-47be-8d9e-8fa0ff2048b4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Request method failure captured: Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 HTTP/1.1 Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCa8aoDq91QBTASQJMWlQ8nFWNPg6BamB8hWwu-nzYM8HH_kQtjKUqr-3lF3OFSp9OYEvzXNa5HedDgXWDgQy3bOzn9G1OnObFp3kRS7Iif4tECzcBk0nH-clIjbYYa8U8Sm70WidWf8rcA8nRzwzutrR6NfeSWJ3VuRiJwB_nLo2I Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 9acebc31809343e0abdc39ee5a127961 Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:20:23.105060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9acebc31809343e0abdc39ee5a127961", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 9acebc31809343e0abdc39ee5a127961 Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-DeleteServersTestJSON-880599112-project Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: e034114ab8244cc99dbf977b458a43f9 Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-DeleteServersTestJSON-880599112-project Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:23.106229 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9'} Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:20:23.106881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:23.108204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:20:23.109418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cdbcd1a8-e54a-47be-8d9e-8fa0ff2048b4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Returning 404 to user: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:20:23.109418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cdbcd1a8-e54a-47be-8d9e-8fa0ff2048b4 tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 404 len: 111 microversion: 2.1 time: 0.034728 Jul 04 09:20:23.109418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 71/126] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:20:23 2022] DELETE /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:20:23.114927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b5a85dbc-9d14-4402-9c31-a8bb5fe7a4ab tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:23.115536 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b5a85dbc-9d14-4402-9c31-a8bb5fe7a4ab tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] [instance: e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:23.122640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5a85dbc-9d14-4402-9c31-a8bb5fe7a4ab tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:23.123462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5a85dbc-9d14-4402-9c31-a8bb5fe7a4ab tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:23.123859 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5a85dbc-9d14-4402-9c31-a8bb5fe7a4ab tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:23.124303 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5a85dbc-9d14-4402-9c31-a8bb5fe7a4ab tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:23.139565 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-b5a85dbc-9d14-4402-9c31-a8bb5fe7a4ab tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] HTTP exception thrown: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b5a85dbc-9d14-4402-9c31-a8bb5fe7a4ab tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Request method failure captured: Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 HTTP/1.1 Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCa8aoDq91QBTASQJMWlQ8nFWNPg6BamB8hWwu-nzYM8HH_kQtjKUqr-3lF3OFSp9OYEvzXNa5HedDgXWDgQy3bOzn9G1OnObFp3kRS7Iif4tECzcBk0nH-clIjbYYa8U8Sm70WidWf8rcA8nRzwzutrR6NfeSWJ3VuRiJwB_nLo2I Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 9acebc31809343e0abdc39ee5a127961 Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:20:23.142042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/9acebc31809343e0abdc39ee5a127961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_9acebc31809343e0abdc39ee5a127961", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 9acebc31809343e0abdc39ee5a127961 Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-DeleteServersTestJSON-880599112 Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-DeleteServersTestJSON-880599112-project Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: e034114ab8244cc99dbf977b458a43f9 Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-DeleteServersTestJSON-880599112-project Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:23.143613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': 'e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9'} Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:20:23.144563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. Jul 04 09:20:23.145816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:20:23.146942 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b5a85dbc-9d14-4402-9c31-a8bb5fe7a4ab tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] Returning 404 to user: Instance e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:20:23.146942 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b5a85dbc-9d14-4402-9c31-a8bb5fe7a4ab tempest-DeleteServersTestJSON-880599112 tempest-DeleteServersTestJSON-880599112-project] 10.222.0.71 "GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9" status: 404 len: 111 microversion: 2.1 time: 0.032313 Jul 04 09:20:23.146942 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 56/127] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:23 2022] GET /compute/v2.1/servers/e1b0d610-0a50-4c35-8b04-ed19d6ba5aa9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:20:29.259357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1609937", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "networks": [{"uuid": "7751e8e2-d957-4c46-b550-d3472313f135"}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:29.334425 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] validate_networks() for [('7751e8e2-d957-4c46-b550-d3472313f135', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:20:30.256567 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:20:30.257292 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:20:30.258309 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:20:30.258757 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:20:30.259155 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:20:30.268174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:30.268753 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:30.269503 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:30.269948 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:30.288122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Getting quotas for project 96bc6b8b0235439587a3a5c9e837d708. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:20:30.293502 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Getting quotas for user 65f1d0ab53de4473acee63b55bf14cab and project 96bc6b8b0235439587a3a5c9e837d708. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:20:30.310688 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:20:30.313020 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:20:30.364010 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cdff4822-0d04-469a-8aa1-ba2f0ce36e82 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.109492 Jul 04 09:20:30.364520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 72/128] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:20:30.378190 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-55df6131-3606-4808-aa52-1aa4eb97f256 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:30.379174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-55df6131-3606-4808-aa52-1aa4eb97f256 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:30.511249 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-55df6131-3606-4808-aa52-1aa4eb97f256 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:30.522870 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-55df6131-3606-4808-aa52-1aa4eb97f256 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1216 microversion: 2.1 time: 0.148240 Jul 04 09:20:30.525843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 57/129] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:30 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:31.544810 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7aeabfef-b2a9-49ba-b7f0-f9f654acbc18 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:31.545475 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7aeabfef-b2a9-49ba-b7f0-f9f654acbc18 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:31.559159 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7aeabfef-b2a9-49ba-b7f0-f9f654acbc18 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:31.559964 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7aeabfef-b2a9-49ba-b7f0-f9f654acbc18 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:31.560822 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7aeabfef-b2a9-49ba-b7f0-f9f654acbc18 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:31.561493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7aeabfef-b2a9-49ba-b7f0-f9f654acbc18 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:31.690315 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7aeabfef-b2a9-49ba-b7f0-f9f654acbc18 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:31.701988 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7aeabfef-b2a9-49ba-b7f0-f9f654acbc18 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1276 microversion: 2.1 time: 0.162905 Jul 04 09:20:31.714893 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 73/130] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:31 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:32.722212 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-aa03134b-e7ff-4812-8d42-6d9a76b7f891 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:32.725461 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-aa03134b-e7ff-4812-8d42-6d9a76b7f891 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:32.741229 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa03134b-e7ff-4812-8d42-6d9a76b7f891 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:32.750316 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa03134b-e7ff-4812-8d42-6d9a76b7f891 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:32.754691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa03134b-e7ff-4812-8d42-6d9a76b7f891 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:32.756061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa03134b-e7ff-4812-8d42-6d9a76b7f891 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:33.040486 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-aa03134b-e7ff-4812-8d42-6d9a76b7f891 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:33.049109 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-aa03134b-e7ff-4812-8d42-6d9a76b7f891 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1316 microversion: 2.1 time: 0.331657 Jul 04 09:20:33.049926 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 58/131] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:32 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:33.659481 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-2e921ec4-8749-4b29-b358-2933ee4b0a5f req-edee2ce6-15fd-415f-8274-1a0c3752c7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef800788-96b8-4498-b1ec-3c1d79859356", "tag": "97ddda1e-b3ff-4108-a50f-c183eb0dbf3e"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:33.684887 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-2e921ec4-8749-4b29-b358-2933ee4b0a5f req-edee2ce6-15fd-415f-8274-1a0c3752c7c6 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:33.685650 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-2e921ec4-8749-4b29-b358-2933ee4b0a5f req-edee2ce6-15fd-415f-8274-1a0c3752c7c6 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:33.699901 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-2e921ec4-8749-4b29-b358-2933ee4b0a5f req-edee2ce6-15fd-415f-8274-1a0c3752c7c6 service nova] Creating event network-changed:97ddda1e-b3ff-4108-a50f-c183eb0dbf3e for instance ef800788-96b8-4498-b1ec-3c1d79859356 on hv-cinder-84456 Jul 04 09:20:33.705453 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-2e921ec4-8749-4b29-b358-2933ee4b0a5f req-edee2ce6-15fd-415f-8274-1a0c3752c7c6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057247 Jul 04 09:20:33.706654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 74/132] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:20:34.072160 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-de86aadf-d941-417b-809e-c00b04efc2d6 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:34.072160 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-de86aadf-d941-417b-809e-c00b04efc2d6 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:34.077846 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de86aadf-d941-417b-809e-c00b04efc2d6 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:34.078307 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de86aadf-d941-417b-809e-c00b04efc2d6 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:34.079091 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de86aadf-d941-417b-809e-c00b04efc2d6 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:34.079536 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-de86aadf-d941-417b-809e-c00b04efc2d6 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:34.236375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-de86aadf-d941-417b-809e-c00b04efc2d6 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:34.245511 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-de86aadf-d941-417b-809e-c00b04efc2d6 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1316 microversion: 2.1 time: 0.181631 Jul 04 09:20:34.246100 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 59/133] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:34 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:34.411590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1871120000", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:34.472801 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] validate_networks() for [('0234e96f-0fff-4fe1-a682-0984ac2a09a5', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:20:34.899425 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:20:34.900033 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:20:34.900511 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:20:34.901643 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:20:34.901904 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:20:34.914762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:34.915298 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:34.916297 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:34.916955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:34.939219 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Getting quotas for project 930dc66606e94d9eb82cc50a67d009fb. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:20:34.943445 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Getting quotas for user 9bcf554f3d6447399e1d9cfe08b0bff7 and project 930dc66606e94d9eb82cc50a67d009fb. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:20:34.956933 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:20:34.959514 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:20:35.012344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-edd959a7-4544-4fd2-9cc4-d52ee0e26286 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.913953 Jul 04 09:20:35.013430 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 75/134] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:20:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:20:35.023190 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d71e4c00-b537-4c81-aeac-365bef11cf0d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:35.025681 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d71e4c00-b537-4c81-aeac-365bef11cf0d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:35.129063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d71e4c00-b537-4c81-aeac-365bef11cf0d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:35.137388 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d71e4c00-b537-4c81-aeac-365bef11cf0d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1222 microversion: 2.1 time: 0.117523 Jul 04 09:20:35.138502 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 60/135] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:35 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:35.264041 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-77deea43-6489-4931-a9a4-784d6a97ec3d tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:35.265599 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-77deea43-6489-4931-a9a4-784d6a97ec3d tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:35.279719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-77deea43-6489-4931-a9a4-784d6a97ec3d tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:35.280819 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-77deea43-6489-4931-a9a4-784d6a97ec3d tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:35.285456 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-77deea43-6489-4931-a9a4-784d6a97ec3d tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:35.286463 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-77deea43-6489-4931-a9a4-784d6a97ec3d tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:35.311001 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-144833313", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:35.409457 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] validate_networks() for [('0234e96f-0fff-4fe1-a682-0984ac2a09a5', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:20:35.575926 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-77deea43-6489-4931-a9a4-784d6a97ec3d tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:35.588778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-77deea43-6489-4931-a9a4-784d6a97ec3d tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1316 microversion: 2.1 time: 0.329113 Jul 04 09:20:35.590322 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 76/136] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:35 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:36.104033 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:20:36.104856 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:20:36.105613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:20:36.106070 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:20:36.106875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:20:36.119350 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:36.119913 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:36.120817 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:36.121344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:36.144592 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Getting quotas for project 930dc66606e94d9eb82cc50a67d009fb. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:20:36.151462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Getting quotas for user 9bcf554f3d6447399e1d9cfe08b0bff7 and project 930dc66606e94d9eb82cc50a67d009fb. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:20:36.167822 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:20:36.171745 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:20:36.241128 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9e1bbc1e-cccc-4468-bc67-0a24dc7f1648 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.934391 Jul 04 09:20:36.242336 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 61/137] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:20:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 09:20:36.251770 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bb6543c7-c824-40ab-9b23-8f40811beb7b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:36.265732 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bb6543c7-c824-40ab-9b23-8f40811beb7b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:36.396066 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bb6543c7-c824-40ab-9b23-8f40811beb7b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:36.409999 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bb6543c7-c824-40ab-9b23-8f40811beb7b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1221 microversion: 2.1 time: 0.160789 Jul 04 09:20:36.421930 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 77/138] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:36 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:36.607655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ab11f87d-a6f0-43c1-8d29-7db4bfc89f12 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:36.608372 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ab11f87d-a6f0-43c1-8d29-7db4bfc89f12 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:36.621127 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab11f87d-a6f0-43c1-8d29-7db4bfc89f12 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:36.621798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab11f87d-a6f0-43c1-8d29-7db4bfc89f12 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:36.623462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab11f87d-a6f0-43c1-8d29-7db4bfc89f12 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:36.623910 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab11f87d-a6f0-43c1-8d29-7db4bfc89f12 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:36.870516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ab11f87d-a6f0-43c1-8d29-7db4bfc89f12 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:36.881783 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ab11f87d-a6f0-43c1-8d29-7db4bfc89f12 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1316 microversion: 2.1 time: 0.278044 Jul 04 09:20:36.883616 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 62/139] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:36 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:37.427919 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1a928869-af10-49a0-97ae-c806251bc057 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:37.429597 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1a928869-af10-49a0-97ae-c806251bc057 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:37.439533 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a928869-af10-49a0-97ae-c806251bc057 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:37.440055 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a928869-af10-49a0-97ae-c806251bc057 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:37.441084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a928869-af10-49a0-97ae-c806251bc057 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:37.441872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a928869-af10-49a0-97ae-c806251bc057 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:37.519948 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1a928869-af10-49a0-97ae-c806251bc057 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:37.533271 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1a928869-af10-49a0-97ae-c806251bc057 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1273 microversion: 2.1 time: 0.109563 Jul 04 09:20:37.534442 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 78/140] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:37 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:37.899086 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-38b05ee1-70dc-4c2f-ad0c-d4c8a34a90bf tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:37.900182 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-38b05ee1-70dc-4c2f-ad0c-d4c8a34a90bf tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:37.906597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38b05ee1-70dc-4c2f-ad0c-d4c8a34a90bf tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:37.907059 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38b05ee1-70dc-4c2f-ad0c-d4c8a34a90bf tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:37.907915 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38b05ee1-70dc-4c2f-ad0c-d4c8a34a90bf tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:37.908358 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38b05ee1-70dc-4c2f-ad0c-d4c8a34a90bf tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:38.072405 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-38b05ee1-70dc-4c2f-ad0c-d4c8a34a90bf tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:38.080344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-38b05ee1-70dc-4c2f-ad0c-d4c8a34a90bf tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1316 microversion: 2.1 time: 0.185874 Jul 04 09:20:38.080944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 63/141] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:37 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:38.555724 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c2c0d0e3-36c3-40ab-95b2-4f08ebf2cbbe tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:38.558659 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c2c0d0e3-36c3-40ab-95b2-4f08ebf2cbbe tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:38.571588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c2c0d0e3-36c3-40ab-95b2-4f08ebf2cbbe tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:38.572247 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c2c0d0e3-36c3-40ab-95b2-4f08ebf2cbbe tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:38.575357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c2c0d0e3-36c3-40ab-95b2-4f08ebf2cbbe tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:38.577758 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c2c0d0e3-36c3-40ab-95b2-4f08ebf2cbbe tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:38.688894 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c2c0d0e3-36c3-40ab-95b2-4f08ebf2cbbe tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:38.707645 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c2c0d0e3-36c3-40ab-95b2-4f08ebf2cbbe tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1279 microversion: 2.1 time: 0.160438 Jul 04 09:20:38.708707 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 79/142] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:38 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:38.919733 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-73e0b79e-2dbd-4b0f-ae75-44388022c893 req-983ee1b9-5b61-4732-8b57-ca9cf86c47b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce", "tag": "d5b73245-e47b-42e3-85c3-556ad9093933"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:38.949115 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-73e0b79e-2dbd-4b0f-ae75-44388022c893 req-983ee1b9-5b61-4732-8b57-ca9cf86c47b0 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:38.949995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-73e0b79e-2dbd-4b0f-ae75-44388022c893 req-983ee1b9-5b61-4732-8b57-ca9cf86c47b0 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:38.974354 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-73e0b79e-2dbd-4b0f-ae75-44388022c893 req-983ee1b9-5b61-4732-8b57-ca9cf86c47b0 service nova] Creating event network-changed:d5b73245-e47b-42e3-85c3-556ad9093933 for instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce on hv-cinder-84456 Jul 04 09:20:38.982720 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-73e0b79e-2dbd-4b0f-ae75-44388022c893 req-983ee1b9-5b61-4732-8b57-ca9cf86c47b0 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070518 Jul 04 09:20:38.983925 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 64/143] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:39.104510 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-49721b2c-ab1f-4367-8ddc-4014324b614e req-b32c1e57-7142-47f2-bd3e-3045a250f381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef800788-96b8-4498-b1ec-3c1d79859356", "name": "network-vif-plugged", "status": "completed", "tag": "97ddda1e-b3ff-4108-a50f-c183eb0dbf3e"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:39.107209 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-65a8a2d4-af17-4733-b5b9-05535352c436 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:39.107836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-65a8a2d4-af17-4733-b5b9-05535352c436 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:39.120756 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65a8a2d4-af17-4733-b5b9-05535352c436 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:39.123505 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-49721b2c-ab1f-4367-8ddc-4014324b614e req-b32c1e57-7142-47f2-bd3e-3045a250f381 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:39.124374 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65a8a2d4-af17-4733-b5b9-05535352c436 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:39.125423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65a8a2d4-af17-4733-b5b9-05535352c436 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:39.126056 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65a8a2d4-af17-4733-b5b9-05535352c436 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:39.127308 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-49721b2c-ab1f-4367-8ddc-4014324b614e req-b32c1e57-7142-47f2-bd3e-3045a250f381 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:39.152777 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-49721b2c-ab1f-4367-8ddc-4014324b614e req-b32c1e57-7142-47f2-bd3e-3045a250f381 service nova] Creating event network-vif-plugged:97ddda1e-b3ff-4108-a50f-c183eb0dbf3e for instance ef800788-96b8-4498-b1ec-3c1d79859356 on hv-cinder-84456 Jul 04 09:20:39.166529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-49721b2c-ab1f-4367-8ddc-4014324b614e req-b32c1e57-7142-47f2-bd3e-3045a250f381 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068600 Jul 04 09:20:39.170487 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 65/144] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:39.421201 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-65a8a2d4-af17-4733-b5b9-05535352c436 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:39.433078 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-65a8a2d4-af17-4733-b5b9-05535352c436 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1316 microversion: 2.1 time: 0.338556 Jul 04 09:20:39.444544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 80/145] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:39 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:39.734127 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8503066d-c18e-4f79-9a67-058334aa48b8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:39.735158 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8503066d-c18e-4f79-9a67-058334aa48b8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:39.741493 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8503066d-c18e-4f79-9a67-058334aa48b8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:39.742718 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8503066d-c18e-4f79-9a67-058334aa48b8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:39.744295 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8503066d-c18e-4f79-9a67-058334aa48b8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:39.744873 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8503066d-c18e-4f79-9a67-058334aa48b8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:39.900799 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8503066d-c18e-4f79-9a67-058334aa48b8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:39.912491 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8503066d-c18e-4f79-9a67-058334aa48b8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.183628 Jul 04 09:20:39.922629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 66/146] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:39 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:40.456670 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ab4171f5-2050-4e97-8bcf-f37d2f0672da tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:40.457345 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ab4171f5-2050-4e97-8bcf-f37d2f0672da tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:40.466482 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab4171f5-2050-4e97-8bcf-f37d2f0672da tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:40.466934 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab4171f5-2050-4e97-8bcf-f37d2f0672da tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:40.467711 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab4171f5-2050-4e97-8bcf-f37d2f0672da tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:40.468147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab4171f5-2050-4e97-8bcf-f37d2f0672da tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:40.635146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ab4171f5-2050-4e97-8bcf-f37d2f0672da tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:40.645731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ab4171f5-2050-4e97-8bcf-f37d2f0672da tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1316 microversion: 2.1 time: 0.194988 Jul 04 09:20:40.645731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 81/147] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:40 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:40.930485 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6a519978-0227-470a-8cfa-537b29a9ba95 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:40.931152 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6a519978-0227-470a-8cfa-537b29a9ba95 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:40.937051 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a519978-0227-470a-8cfa-537b29a9ba95 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:40.937513 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a519978-0227-470a-8cfa-537b29a9ba95 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:40.938271 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a519978-0227-470a-8cfa-537b29a9ba95 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:40.938702 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a519978-0227-470a-8cfa-537b29a9ba95 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:41.005206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-dc5b3411-407a-4d6f-8f0b-b83438944205 req-b7fc0cfd-7ed2-4348-9785-66e9ab9925b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308d33d7-4ded-4d69-80a0-d4c2f48394cd", "tag": "0e681d8c-93d6-48fe-b3d5-a670e2d5dd33"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:41.014334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-dc5b3411-407a-4d6f-8f0b-b83438944205 req-b7fc0cfd-7ed2-4348-9785-66e9ab9925b5 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:41.014782 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-dc5b3411-407a-4d6f-8f0b-b83438944205 req-b7fc0cfd-7ed2-4348-9785-66e9ab9925b5 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:41.027187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-dc5b3411-407a-4d6f-8f0b-b83438944205 req-b7fc0cfd-7ed2-4348-9785-66e9ab9925b5 service nova] Creating event network-changed:0e681d8c-93d6-48fe-b3d5-a670e2d5dd33 for instance 308d33d7-4ded-4d69-80a0-d4c2f48394cd on hv-cinder-84456 Jul 04 09:20:41.032261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-dc5b3411-407a-4d6f-8f0b-b83438944205 req-b7fc0cfd-7ed2-4348-9785-66e9ab9925b5 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030702 Jul 04 09:20:41.033390 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 82/148] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:20:41.092184 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6a519978-0227-470a-8cfa-537b29a9ba95 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:41.099839 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6a519978-0227-470a-8cfa-537b29a9ba95 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.173579 Jul 04 09:20:41.100455 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 67/149] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:40 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:41.662830 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9ffeb541-742f-4be8-994c-0cdbfb254f3c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:41.664162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9ffeb541-742f-4be8-994c-0cdbfb254f3c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:41.672911 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ffeb541-742f-4be8-994c-0cdbfb254f3c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:41.673378 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ffeb541-742f-4be8-994c-0cdbfb254f3c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:41.674427 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ffeb541-742f-4be8-994c-0cdbfb254f3c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:41.675003 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ffeb541-742f-4be8-994c-0cdbfb254f3c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:41.840731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9ffeb541-742f-4be8-994c-0cdbfb254f3c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:41.849531 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9ffeb541-742f-4be8-994c-0cdbfb254f3c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1316 microversion: 2.1 time: 0.192295 Jul 04 09:20:41.850764 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 83/150] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:41 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:42.118389 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-484c9a56-b7b7-4f9a-9ffa-cdf2e108dcdd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:42.119000 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-484c9a56-b7b7-4f9a-9ffa-cdf2e108dcdd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:42.125417 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-484c9a56-b7b7-4f9a-9ffa-cdf2e108dcdd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:42.125869 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-484c9a56-b7b7-4f9a-9ffa-cdf2e108dcdd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:42.126789 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-484c9a56-b7b7-4f9a-9ffa-cdf2e108dcdd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:42.127376 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-484c9a56-b7b7-4f9a-9ffa-cdf2e108dcdd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:42.276446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-484c9a56-b7b7-4f9a-9ffa-cdf2e108dcdd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:42.284817 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-484c9a56-b7b7-4f9a-9ffa-cdf2e108dcdd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.171373 Jul 04 09:20:42.285873 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 68/151] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:42 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:42.867286 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2f3cdb0f-e5a7-4be3-afcc-c5eefefbc6b8 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:42.867911 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2f3cdb0f-e5a7-4be3-afcc-c5eefefbc6b8 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:42.874596 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f3cdb0f-e5a7-4be3-afcc-c5eefefbc6b8 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:42.875054 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f3cdb0f-e5a7-4be3-afcc-c5eefefbc6b8 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:42.875897 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f3cdb0f-e5a7-4be3-afcc-c5eefefbc6b8 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:42.876361 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2f3cdb0f-e5a7-4be3-afcc-c5eefefbc6b8 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:42.937615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a5fdc19b-3da6-40ba-97e0-77a1372a0ada tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:42.938391 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a5fdc19b-3da6-40ba-97e0-77a1372a0ada tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:42.947800 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5fdc19b-3da6-40ba-97e0-77a1372a0ada tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:42.948486 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5fdc19b-3da6-40ba-97e0-77a1372a0ada tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:42.950345 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5fdc19b-3da6-40ba-97e0-77a1372a0ada tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:42.951185 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a5fdc19b-3da6-40ba-97e0-77a1372a0ada tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:42.983047 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a5fdc19b-3da6-40ba-97e0-77a1372a0ada tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/ips" status: 200 len: 150 microversion: 2.1 time: 0.049705 Jul 04 09:20:42.984237 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 69/152] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 4 09:20:42 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:43.031011 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2f3cdb0f-e5a7-4be3-afcc-c5eefefbc6b8 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:43.039696 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2f3cdb0f-e5a7-4be3-afcc-c5eefefbc6b8 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1505 microversion: 2.1 time: 0.176317 Jul 04 09:20:43.040995 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 84/153] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:42 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:43.304845 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-00200f58-6db6-406a-b179-8ca61e91bd19 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:43.306782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-00200f58-6db6-406a-b179-8ca61e91bd19 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:43.321690 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00200f58-6db6-406a-b179-8ca61e91bd19 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:43.323596 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00200f58-6db6-406a-b179-8ca61e91bd19 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:43.325203 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00200f58-6db6-406a-b179-8ca61e91bd19 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:43.326165 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00200f58-6db6-406a-b179-8ca61e91bd19 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:43.623435 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-00200f58-6db6-406a-b179-8ca61e91bd19 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:43.632967 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-00200f58-6db6-406a-b179-8ca61e91bd19 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.333742 Jul 04 09:20:43.634603 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 70/154] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:43 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:43.664214 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1403440136", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "networks": [{"uuid": "b2b6be8b-cc07-42e4-b64d-bbd2e36617c1"}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:43.724008 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] validate_networks() for [('b2b6be8b-cc07-42e4-b64d-bbd2e36617c1', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:20:44.108376 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:20:44.108929 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:20:44.109402 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:20:44.109821 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:20:44.110244 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:20:44.120668 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:44.121783 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:44.121960 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:44.122539 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:44.139557 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Getting quotas for project d6ecddd48b9a466880e0288edd65ce0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:20:44.144020 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Getting quotas for user 44e20abe50c041c0b52d788b1cb237fe and project d6ecddd48b9a466880e0288edd65ce0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:20:44.159618 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:20:44.162350 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:20:44.213891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b26f9c96-08e5-4118-b3e8-73003f9b693f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553855 Jul 04 09:20:44.214795 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 85/155] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:20:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:20:44.225219 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c8fcbc25-c38d-4395-8ae6-203b0c66b85e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:44.225847 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c8fcbc25-c38d-4395-8ae6-203b0c66b85e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:44.281621 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c8fcbc25-c38d-4395-8ae6-203b0c66b85e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:44.288518 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c8fcbc25-c38d-4395-8ae6-203b0c66b85e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1214 microversion: 2.1 time: 0.067420 Jul 04 09:20:44.289719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 71/156] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:44 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:44.651339 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bbc28e43-9303-4f59-9c06-20f35873c504 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:44.651953 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bbc28e43-9303-4f59-9c06-20f35873c504 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:44.654035 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:44.659392 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-90345705-91af-4c05-ae9f-cc5bfd8de9f7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a16d928d-da6f-4ed0-8413-0ea907bc4c19"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:44.659920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bbc28e43-9303-4f59-9c06-20f35873c504 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:44.660146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bbc28e43-9303-4f59-9c06-20f35873c504 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:44.660484 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-90345705-91af-4c05-ae9f-cc5bfd8de9f7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:44.660918 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bbc28e43-9303-4f59-9c06-20f35873c504 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:44.661394 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bbc28e43-9303-4f59-9c06-20f35873c504 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:44.662504 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:44.666677 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:44.672430 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-90345705-91af-4c05-ae9f-cc5bfd8de9f7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:44.673184 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-90345705-91af-4c05-ae9f-cc5bfd8de9f7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:44.674366 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-90345705-91af-4c05-ae9f-cc5bfd8de9f7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:44.674993 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-90345705-91af-4c05-ae9f-cc5bfd8de9f7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:44.680386 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=83 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:44.810405 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bbc28e43-9303-4f59-9c06-20f35873c504 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:44.817943 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bbc28e43-9303-4f59-9c06-20f35873c504 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.171219 Jul 04 09:20:44.818514 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 86/157] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:44 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:45.063015 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-4eda98e3-3ebd-4f89-af7b-f9e9f442c902 req-67650a71-63b4-4008-8337-9e17641a3402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce", "name": "network-vif-plugged", "status": "completed", "tag": "d5b73245-e47b-42e3-85c3-556ad9093933"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:45.074393 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-4eda98e3-3ebd-4f89-af7b-f9e9f442c902 req-67650a71-63b4-4008-8337-9e17641a3402 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:45.074849 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-4eda98e3-3ebd-4f89-af7b-f9e9f442c902 req-67650a71-63b4-4008-8337-9e17641a3402 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:45.088646 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-4eda98e3-3ebd-4f89-af7b-f9e9f442c902 req-67650a71-63b4-4008-8337-9e17641a3402 service nova] Creating event network-vif-plugged:d5b73245-e47b-42e3-85c3-556ad9093933 for instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce on hv-cinder-84456 Jul 04 09:20:45.094573 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-4eda98e3-3ebd-4f89-af7b-f9e9f442c902 req-67650a71-63b4-4008-8337-9e17641a3402 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035994 Jul 04 09:20:45.095975 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 87/158] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:20:45.191704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-90345705-91af-4c05-ae9f-cc5bfd8de9f7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536075 Jul 04 09:20:45.193071 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 72/159] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:20:44 2022] POST /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:20:45.306796 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-676822b6-0bf7-4f78-bcc2-7e834e068094 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:45.307502 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-676822b6-0bf7-4f78-bcc2-7e834e068094 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:45.313949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-676822b6-0bf7-4f78-bcc2-7e834e068094 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:45.314341 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-676822b6-0bf7-4f78-bcc2-7e834e068094 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:45.315108 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-676822b6-0bf7-4f78-bcc2-7e834e068094 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:45.315546 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-676822b6-0bf7-4f78-bcc2-7e834e068094 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:45.378792 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-676822b6-0bf7-4f78-bcc2-7e834e068094 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:45.387166 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-676822b6-0bf7-4f78-bcc2-7e834e068094 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1266 microversion: 2.1 time: 0.084816 Jul 04 09:20:45.387740 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 88/160] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:45 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:45.834958 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0fb7715a-cfad-4bed-8eba-5b8767e82829 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:45.835617 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0fb7715a-cfad-4bed-8eba-5b8767e82829 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:45.843762 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0fb7715a-cfad-4bed-8eba-5b8767e82829 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:45.844241 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0fb7715a-cfad-4bed-8eba-5b8767e82829 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:45.845100 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0fb7715a-cfad-4bed-8eba-5b8767e82829 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:45.845543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0fb7715a-cfad-4bed-8eba-5b8767e82829 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:45.985851 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0fb7715a-cfad-4bed-8eba-5b8767e82829 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:45.997882 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0fb7715a-cfad-4bed-8eba-5b8767e82829 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.167368 Jul 04 09:20:45.999703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 73/161] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:45 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:46.404868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b6a1b05d-71ae-45c6-bb52-ca50f6e7f481 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:46.405771 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b6a1b05d-71ae-45c6-bb52-ca50f6e7f481 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:46.414373 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b6a1b05d-71ae-45c6-bb52-ca50f6e7f481 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:46.414776 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b6a1b05d-71ae-45c6-bb52-ca50f6e7f481 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:46.415687 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b6a1b05d-71ae-45c6-bb52-ca50f6e7f481 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:46.416481 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b6a1b05d-71ae-45c6-bb52-ca50f6e7f481 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:46.556139 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b6a1b05d-71ae-45c6-bb52-ca50f6e7f481 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:46.563576 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b6a1b05d-71ae-45c6-bb52-ca50f6e7f481 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1314 microversion: 2.1 time: 0.162863 Jul 04 09:20:46.564136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 89/162] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:46 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:46.711210 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ced5290a-a80e-4dae-9d49-93eacfbf0f1c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:46.712317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ced5290a-a80e-4dae-9d49-93eacfbf0f1c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:46.716146 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:46.720238 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ced5290a-a80e-4dae-9d49-93eacfbf0f1c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:46.720686 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ced5290a-a80e-4dae-9d49-93eacfbf0f1c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:46.721505 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ced5290a-a80e-4dae-9d49-93eacfbf0f1c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:46.721936 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ced5290a-a80e-4dae-9d49-93eacfbf0f1c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:46.746825 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ced5290a-a80e-4dae-9d49-93eacfbf0f1c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/ips" status: 200 len: 147 microversion: 2.1 time: 0.040157 Jul 04 09:20:46.747403 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 74/163] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 4 09:20:46 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:47.014982 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c3c4cae5-0dd9-484e-b702-5a99789db426 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:47.015775 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c3c4cae5-0dd9-484e-b702-5a99789db426 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:47.028052 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3c4cae5-0dd9-484e-b702-5a99789db426 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:47.028649 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3c4cae5-0dd9-484e-b702-5a99789db426 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:47.030100 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3c4cae5-0dd9-484e-b702-5a99789db426 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:47.030617 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3c4cae5-0dd9-484e-b702-5a99789db426 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:47.230194 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c3c4cae5-0dd9-484e-b702-5a99789db426 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:47.237824 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c3c4cae5-0dd9-484e-b702-5a99789db426 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.226598 Jul 04 09:20:47.238336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 90/164] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:47 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:47.358933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-dc387944-fe53-42c7-8934-d7800f51594d req-71903629-75c8-4727-bd6e-fa2bfc9d812c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c58438ed-b134-47ca-9d9f-e65c7487e0f4", "tag": "a26599e8-b391-4bfd-952e-b70478cffdae"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:47.369181 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-dc387944-fe53-42c7-8934-d7800f51594d req-71903629-75c8-4727-bd6e-fa2bfc9d812c service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:47.369912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-dc387944-fe53-42c7-8934-d7800f51594d req-71903629-75c8-4727-bd6e-fa2bfc9d812c service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:47.383296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-dc387944-fe53-42c7-8934-d7800f51594d req-71903629-75c8-4727-bd6e-fa2bfc9d812c service nova] Creating event network-changed:a26599e8-b391-4bfd-952e-b70478cffdae for instance c58438ed-b134-47ca-9d9f-e65c7487e0f4 on hv-cinder-84456 Jul 04 09:20:47.388415 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-dc387944-fe53-42c7-8934-d7800f51594d req-71903629-75c8-4727-bd6e-fa2bfc9d812c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032985 Jul 04 09:20:47.389653 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 75/165] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:47.580951 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5f8c64e3-5703-43d4-b7d6-3ff5b9569077 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:47.581693 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5f8c64e3-5703-43d4-b7d6-3ff5b9569077 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:47.588705 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f8c64e3-5703-43d4-b7d6-3ff5b9569077 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:47.589527 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f8c64e3-5703-43d4-b7d6-3ff5b9569077 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:47.590303 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f8c64e3-5703-43d4-b7d6-3ff5b9569077 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:47.590749 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f8c64e3-5703-43d4-b7d6-3ff5b9569077 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:47.724939 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5f8c64e3-5703-43d4-b7d6-3ff5b9569077 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:47.733236 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5f8c64e3-5703-43d4-b7d6-3ff5b9569077 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1314 microversion: 2.1 time: 0.156070 Jul 04 09:20:47.733782 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 91/166] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:47 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:48.254526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-587c6d79-bcb0-44c7-bfad-dcf9f62b09cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:48.255264 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-587c6d79-bcb0-44c7-bfad-dcf9f62b09cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:48.261754 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-587c6d79-bcb0-44c7-bfad-dcf9f62b09cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:48.262217 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-587c6d79-bcb0-44c7-bfad-dcf9f62b09cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:48.262996 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-587c6d79-bcb0-44c7-bfad-dcf9f62b09cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:48.263441 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-587c6d79-bcb0-44c7-bfad-dcf9f62b09cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:48.406389 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-587c6d79-bcb0-44c7-bfad-dcf9f62b09cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:48.420286 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-587c6d79-bcb0-44c7-bfad-dcf9f62b09cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.169932 Jul 04 09:20:48.421104 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 76/167] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:48 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:48.751333 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-46e3aa9f-5ae3-44f2-b1fd-a87385fbabe9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:48.752092 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-46e3aa9f-5ae3-44f2-b1fd-a87385fbabe9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:48.759944 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-46e3aa9f-5ae3-44f2-b1fd-a87385fbabe9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:48.760392 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-46e3aa9f-5ae3-44f2-b1fd-a87385fbabe9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:48.761199 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-46e3aa9f-5ae3-44f2-b1fd-a87385fbabe9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:48.761631 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-46e3aa9f-5ae3-44f2-b1fd-a87385fbabe9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:48.893261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-46e3aa9f-5ae3-44f2-b1fd-a87385fbabe9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:48.902557 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-46e3aa9f-5ae3-44f2-b1fd-a87385fbabe9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1314 microversion: 2.1 time: 0.155129 Jul 04 09:20:48.903133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 92/168] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:48 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:49.080079 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-ee0812b4-c2a0-4b9e-b343-3456a38559b4 req-4ae4ec5f-f2f3-4467-b3d4-4f9522a2ae14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308d33d7-4ded-4d69-80a0-d4c2f48394cd", "name": "network-vif-plugged", "status": "completed", "tag": "0e681d8c-93d6-48fe-b3d5-a670e2d5dd33"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:49.089710 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-ee0812b4-c2a0-4b9e-b343-3456a38559b4 req-4ae4ec5f-f2f3-4467-b3d4-4f9522a2ae14 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:49.090161 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-ee0812b4-c2a0-4b9e-b343-3456a38559b4 req-4ae4ec5f-f2f3-4467-b3d4-4f9522a2ae14 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:49.102689 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-ee0812b4-c2a0-4b9e-b343-3456a38559b4 req-4ae4ec5f-f2f3-4467-b3d4-4f9522a2ae14 service nova] Creating event network-vif-plugged:0e681d8c-93d6-48fe-b3d5-a670e2d5dd33 for instance 308d33d7-4ded-4d69-80a0-d4c2f48394cd on hv-cinder-84456 Jul 04 09:20:49.107388 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-ee0812b4-c2a0-4b9e-b343-3456a38559b4 req-4ae4ec5f-f2f3-4467-b3d4-4f9522a2ae14 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030980 Jul 04 09:20:49.107988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 77/169] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:49.437230 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ecbd9a51-186c-4e07-ae2e-b9cf2ccb1244 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:49.438095 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ecbd9a51-186c-4e07-ae2e-b9cf2ccb1244 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:49.444193 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ecbd9a51-186c-4e07-ae2e-b9cf2ccb1244 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:49.444647 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ecbd9a51-186c-4e07-ae2e-b9cf2ccb1244 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:49.446078 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ecbd9a51-186c-4e07-ae2e-b9cf2ccb1244 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:49.446548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ecbd9a51-186c-4e07-ae2e-b9cf2ccb1244 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:49.578406 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ecbd9a51-186c-4e07-ae2e-b9cf2ccb1244 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:49.585988 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ecbd9a51-186c-4e07-ae2e-b9cf2ccb1244 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.152575 Jul 04 09:20:49.586546 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 93/170] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:49 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:49.923895 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8023c66a-fb69-4317-8a7d-4df52e55f04b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:49.924602 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8023c66a-fb69-4317-8a7d-4df52e55f04b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:49.936682 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8023c66a-fb69-4317-8a7d-4df52e55f04b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:49.937881 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8023c66a-fb69-4317-8a7d-4df52e55f04b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:49.939337 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8023c66a-fb69-4317-8a7d-4df52e55f04b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:49.940292 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8023c66a-fb69-4317-8a7d-4df52e55f04b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:50.078759 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8023c66a-fb69-4317-8a7d-4df52e55f04b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:50.087007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8023c66a-fb69-4317-8a7d-4df52e55f04b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1314 microversion: 2.1 time: 0.169609 Jul 04 09:20:50.087581 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 78/171] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:49 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:50.602982 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2559dc81-e180-4535-b7d1-4d2741fa5824 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:50.603574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2559dc81-e180-4535-b7d1-4d2741fa5824 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:50.610177 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2559dc81-e180-4535-b7d1-4d2741fa5824 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:50.610633 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2559dc81-e180-4535-b7d1-4d2741fa5824 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:50.611400 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2559dc81-e180-4535-b7d1-4d2741fa5824 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:50.611841 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2559dc81-e180-4535-b7d1-4d2741fa5824 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:50.744980 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2559dc81-e180-4535-b7d1-4d2741fa5824 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:50.752484 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2559dc81-e180-4535-b7d1-4d2741fa5824 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.153510 Jul 04 09:20:50.753057 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 94/172] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:50 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:50.959117 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b50dac80-9007-4b89-b626-202faf050f75 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c9432f6-cc12-4227-a48c-88ac4f567701"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:50.960188 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b50dac80-9007-4b89-b626-202faf050f75 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:50.967337 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b50dac80-9007-4b89-b626-202faf050f75 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:50.967795 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b50dac80-9007-4b89-b626-202faf050f75 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:50.968672 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b50dac80-9007-4b89-b626-202faf050f75 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:50.969108 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b50dac80-9007-4b89-b626-202faf050f75 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:51.105495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2df6f286-1273-4929-ba9b-10aaf7f0aa29 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:51.106192 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2df6f286-1273-4929-ba9b-10aaf7f0aa29 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:51.112655 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2df6f286-1273-4929-ba9b-10aaf7f0aa29 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:51.113270 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2df6f286-1273-4929-ba9b-10aaf7f0aa29 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:51.114105 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2df6f286-1273-4929-ba9b-10aaf7f0aa29 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:51.114726 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2df6f286-1273-4929-ba9b-10aaf7f0aa29 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:51.259636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b50dac80-9007-4b89-b626-202faf050f75 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304281 Jul 04 09:20:51.260284 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 79/173] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:20:50 2022] POST /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:51.265299 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2df6f286-1273-4929-ba9b-10aaf7f0aa29 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:51.272775 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2df6f286-1273-4929-ba9b-10aaf7f0aa29 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1314 microversion: 2.1 time: 0.172623 Jul 04 09:20:51.275020 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 95/174] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:51 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:51.770775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-034d63d9-1add-4c38-80be-082ee3417b6c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:51.771469 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-034d63d9-1add-4c38-80be-082ee3417b6c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:51.778420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-034d63d9-1add-4c38-80be-082ee3417b6c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:51.778890 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-034d63d9-1add-4c38-80be-082ee3417b6c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:51.779659 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-034d63d9-1add-4c38-80be-082ee3417b6c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:51.780276 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-034d63d9-1add-4c38-80be-082ee3417b6c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:51.914961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-034d63d9-1add-4c38-80be-082ee3417b6c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:51.923858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-034d63d9-1add-4c38-80be-082ee3417b6c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1321 microversion: 2.1 time: 0.157165 Jul 04 09:20:51.924837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 80/175] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:51 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:52.291618 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e0003840-b850-4c20-bb18-e48c49e5bd78 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:52.292233 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e0003840-b850-4c20-bb18-e48c49e5bd78 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:52.298834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e0003840-b850-4c20-bb18-e48c49e5bd78 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:52.299280 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e0003840-b850-4c20-bb18-e48c49e5bd78 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:52.300040 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e0003840-b850-4c20-bb18-e48c49e5bd78 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:52.300477 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e0003840-b850-4c20-bb18-e48c49e5bd78 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:52.433953 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e0003840-b850-4c20-bb18-e48c49e5bd78 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:52.441379 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e0003840-b850-4c20-bb18-e48c49e5bd78 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1314 microversion: 2.1 time: 0.153846 Jul 04 09:20:52.441962 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 96/176] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:52 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:52.940688 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-38666b33-fa5e-443c-a8dd-26f3abae1cbb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:52.941272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-38666b33-fa5e-443c-a8dd-26f3abae1cbb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:52.948326 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38666b33-fa5e-443c-a8dd-26f3abae1cbb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:52.948780 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38666b33-fa5e-443c-a8dd-26f3abae1cbb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:52.949924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38666b33-fa5e-443c-a8dd-26f3abae1cbb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:52.950376 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38666b33-fa5e-443c-a8dd-26f3abae1cbb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.095669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-38666b33-fa5e-443c-a8dd-26f3abae1cbb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:53.105465 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-38666b33-fa5e-443c-a8dd-26f3abae1cbb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1514 microversion: 2.1 time: 0.168328 Jul 04 09:20:53.106381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 81/177] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:52 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:53.122921 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-ba3bb55d-8223-4c0e-8e77-2c3bd7b8114e req-6ac938eb-884a-4851-9ede-ef4bb1a02282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58438ed-b134-47ca-9d9f-e65c7487e0f4", "name": "network-vif-plugged", "status": "completed", "tag": "a26599e8-b391-4bfd-952e-b70478cffdae"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:53.135577 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ba3bb55d-8223-4c0e-8e77-2c3bd7b8114e req-6ac938eb-884a-4851-9ede-ef4bb1a02282 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:53.136760 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3760f91c-e9d9-4c8c-9e98-800af6be9535 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:53.137858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3760f91c-e9d9-4c8c-9e98-800af6be9535 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:53.143214 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ba3bb55d-8223-4c0e-8e77-2c3bd7b8114e req-6ac938eb-884a-4851-9ede-ef4bb1a02282 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.145023 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3760f91c-e9d9-4c8c-9e98-800af6be9535 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:53.145526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3760f91c-e9d9-4c8c-9e98-800af6be9535 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.146488 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3760f91c-e9d9-4c8c-9e98-800af6be9535 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:53.146933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3760f91c-e9d9-4c8c-9e98-800af6be9535 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.169479 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-ba3bb55d-8223-4c0e-8e77-2c3bd7b8114e req-6ac938eb-884a-4851-9ede-ef4bb1a02282 service nova] Creating event network-vif-plugged:a26599e8-b391-4bfd-952e-b70478cffdae for instance c58438ed-b134-47ca-9d9f-e65c7487e0f4 on hv-cinder-84456 Jul 04 09:20:53.182084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-ba3bb55d-8223-4c0e-8e77-2c3bd7b8114e req-6ac938eb-884a-4851-9ede-ef4bb1a02282 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064633 Jul 04 09:20:53.183226 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 97/178] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:53.187166 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-3760f91c-e9d9-4c8c-9e98-800af6be9535 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lazy-loading 'flavor' on Instance uuid 308d33d7-4ded-4d69-80a0-d4c2f48394cd {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:20:53.328342 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3760f91c-e9d9-4c8c-9e98-800af6be9535 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd/action" status: 200 len: 32 microversion: 2.1 time: 0.197959 Jul 04 09:20:53.328985 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 82/179] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:20:53 2022] POST /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:20:53.340393 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cbff1231-40c9-4d5c-8fc2-f5b9d0ebc300 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:53.341316 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cbff1231-40c9-4d5c-8fc2-f5b9d0ebc300 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:53.354172 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cbff1231-40c9-4d5c-8fc2-f5b9d0ebc300 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:53.355574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cbff1231-40c9-4d5c-8fc2-f5b9d0ebc300 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.356855 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cbff1231-40c9-4d5c-8fc2-f5b9d0ebc300 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:53.357561 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cbff1231-40c9-4d5c-8fc2-f5b9d0ebc300 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.462687 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ad0b4068-ac29-47d8-8f6c-710dff1cd189 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:53.463545 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ad0b4068-ac29-47d8-8f6c-710dff1cd189 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:53.471566 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ad0b4068-ac29-47d8-8f6c-710dff1cd189 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:53.472026 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ad0b4068-ac29-47d8-8f6c-710dff1cd189 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.472801 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ad0b4068-ac29-47d8-8f6c-710dff1cd189 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:53.473270 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ad0b4068-ac29-47d8-8f6c-710dff1cd189 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:53.559395 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cbff1231-40c9-4d5c-8fc2-f5b9d0ebc300 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:53.568553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cbff1231-40c9-4d5c-8fc2-f5b9d0ebc300 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.234089 Jul 04 09:20:53.573143 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 98/180] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:53 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:53.635501 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ad0b4068-ac29-47d8-8f6c-710dff1cd189 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:53.643375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ad0b4068-ac29-47d8-8f6c-710dff1cd189 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1314 microversion: 2.1 time: 0.187761 Jul 04 09:20:53.643953 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 83/181] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:53 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:53.767722 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-15db16c3-b344-47cb-986e-7d01cf8ad315 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: .version_select at 0x7fad7ad3a280>, body: {"keypair": {"name": "tempest-keypair-214595318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8/iY4REuImwDhhDlZrMyY9ULx0x0pfD0kUGOp3Z92Usw0OUYzXDuM59ybWQl4c0ehVg6bXrr8hnjzXsEzAAuaEKYkj99FDn/XAE0CZSGp9Ji79O2HosmmwzecTlJaDsQ=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:53.781753 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-15db16c3-b344-47cb-986e-7d01cf8ad315 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for project ba157b0e49f1447e82755035db8728d5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:20:53.785802 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-15db16c3-b344-47cb-986e-7d01cf8ad315 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for user 6bc30b7d536444008e5b5bab45c5c438 and project ba157b0e49f1447e82755035db8728d5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:20:53.808080 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-15db16c3-b344-47cb-986e-7d01cf8ad315 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044239 Jul 04 09:20:53.808671 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 99/182] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 4 09:20:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:20:54.587679 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-59a5f687-b631-472c-9be8-c2a7c5a8e783 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:54.589446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-59a5f687-b631-472c-9be8-c2a7c5a8e783 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:54.592757 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=12 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:54.598746 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59a5f687-b631-472c-9be8-c2a7c5a8e783 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:54.599173 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59a5f687-b631-472c-9be8-c2a7c5a8e783 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:54.600108 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59a5f687-b631-472c-9be8-c2a7c5a8e783 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:54.600870 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59a5f687-b631-472c-9be8-c2a7c5a8e783 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:54.656593 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:54.662370 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8edc9916-8d79-4c36-8739-68468b0690cf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:54.663073 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8edc9916-8d79-4c36-8739-68468b0690cf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:54.670546 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8edc9916-8d79-4c36-8739-68468b0690cf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:54.671098 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8edc9916-8d79-4c36-8739-68468b0690cf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:54.671956 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8edc9916-8d79-4c36-8739-68468b0690cf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:54.672536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8edc9916-8d79-4c36-8739-68468b0690cf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:54.901665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-59a5f687-b631-472c-9be8-c2a7c5a8e783 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:54.909569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-59a5f687-b631-472c-9be8-c2a7c5a8e783 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.326519 Jul 04 09:20:54.910149 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 84/183] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:54 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:54.946980 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8edc9916-8d79-4c36-8739-68468b0690cf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:54.961933 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8edc9916-8d79-4c36-8739-68468b0690cf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1314 microversion: 2.1 time: 0.305363 Jul 04 09:20:54.963190 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 100/184] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:54 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:55.343664 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1743536227", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599dfd4b-618e-4261-9f6d-462c4cc71e5b"}], "security_groups": [{"name": "tempest-securitygroup--1970131056"}], "key_name": "tempest-keypair-214595318", "user_data": "}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:20:55.636853 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] validate_networks() for [('599dfd4b-618e-4261-9f6d-462c4cc71e5b', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:20:55.926491 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9b1a5ba1-570a-4c94-8cea-71c184355733 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:55.927186 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9b1a5ba1-570a-4c94-8cea-71c184355733 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:55.935735 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9b1a5ba1-570a-4c94-8cea-71c184355733 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:55.936251 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9b1a5ba1-570a-4c94-8cea-71c184355733 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:55.937066 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9b1a5ba1-570a-4c94-8cea-71c184355733 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:55.937505 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9b1a5ba1-570a-4c94-8cea-71c184355733 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:56.057486 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:20:56.057918 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:20:56.058428 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:20:56.058870 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:20:56.059322 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:20:56.069066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:56.069534 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:56.070348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:56.071892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:56.088604 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for project ba157b0e49f1447e82755035db8728d5. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:20:56.093239 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for user 6bc30b7d536444008e5b5bab45c5c438 and project ba157b0e49f1447e82755035db8728d5. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:20:56.105446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:20:56.107733 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:20:56.108249 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9b1a5ba1-570a-4c94-8cea-71c184355733 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:56.115637 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9b1a5ba1-570a-4c94-8cea-71c184355733 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.192940 Jul 04 09:20:56.116213 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 101/185] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:55 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:56.122412 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-67969508-d986-4971-9e76-a3b9c10c97fc tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:56.123009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-67969508-d986-4971-9e76-a3b9c10c97fc tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:56.129425 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67969508-d986-4971-9e76-a3b9c10c97fc tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:56.129827 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67969508-d986-4971-9e76-a3b9c10c97fc tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:56.130612 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67969508-d986-4971-9e76-a3b9c10c97fc tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:56.131041 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67969508-d986-4971-9e76-a3b9c10c97fc tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:56.156615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fcdb960e-180e-4383-aa65-6db6f666ecaa tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.817176 Jul 04 09:20:56.162177 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 85/186] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:20:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:20:56.172707 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-69544125-df0e-4ef2-ba54-f343977ecdac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:56.174171 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-69544125-df0e-4ef2-ba54-f343977ecdac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:56.238268 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-69544125-df0e-4ef2-ba54-f343977ecdac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:56.247521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-69544125-df0e-4ef2-ba54-f343977ecdac tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1241 microversion: 2.1 time: 0.083453 Jul 04 09:20:56.248502 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 86/187] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:56 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:56.307769 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-67969508-d986-4971-9e76-a3b9c10c97fc tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:56.320329 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-67969508-d986-4971-9e76-a3b9c10c97fc tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1498 microversion: 2.1 time: 0.203152 Jul 04 09:20:56.321750 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 102/188] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:56 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1498 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:56.819617 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-27042887-1c82-4d0a-8a82-525caf06964c tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:56.820214 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-27042887-1c82-4d0a-8a82-525caf06964c tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:56.827181 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27042887-1c82-4d0a-8a82-525caf06964c tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:56.827639 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27042887-1c82-4d0a-8a82-525caf06964c tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:56.828414 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27042887-1c82-4d0a-8a82-525caf06964c tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:56.828857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27042887-1c82-4d0a-8a82-525caf06964c tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:56.844831 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:56.857303 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-27042887-1c82-4d0a-8a82-525caf06964c tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:20:56.941831 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-27042887-1c82-4d0a-8a82-525caf06964c tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 204 len: 0 microversion: 2.1 time: 0.126027 Jul 04 09:20:56.942417 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 87/189] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:20:56 2022] DELETE /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:20:56.950578 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bdd68018-f899-4561-a64f-032dcad3546a tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:56.951190 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bdd68018-f899-4561-a64f-032dcad3546a tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:56.957936 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bdd68018-f899-4561-a64f-032dcad3546a tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:56.958389 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bdd68018-f899-4561-a64f-032dcad3546a tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:56.959156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bdd68018-f899-4561-a64f-032dcad3546a tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:56.959595 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bdd68018-f899-4561-a64f-032dcad3546a tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:57.090973 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bdd68018-f899-4561-a64f-032dcad3546a tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:57.098807 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bdd68018-f899-4561-a64f-032dcad3546a tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1504 microversion: 2.1 time: 0.152027 Jul 04 09:20:57.099387 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 103/190] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:56 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:57.134062 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-28af7a0b-3810-4079-8016-78db08e67f9c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:57.134711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-28af7a0b-3810-4079-8016-78db08e67f9c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:57.140900 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-28af7a0b-3810-4079-8016-78db08e67f9c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:57.141398 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-28af7a0b-3810-4079-8016-78db08e67f9c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:57.142168 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-28af7a0b-3810-4079-8016-78db08e67f9c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:57.142608 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-28af7a0b-3810-4079-8016-78db08e67f9c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:57.269032 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5d7fcc23-3d3a-41d5-b6fe-5bdcf087c0a0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:57.270089 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5d7fcc23-3d3a-41d5-b6fe-5bdcf087c0a0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:57.277697 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7fcc23-3d3a-41d5-b6fe-5bdcf087c0a0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:57.278562 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7fcc23-3d3a-41d5-b6fe-5bdcf087c0a0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:57.279880 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7fcc23-3d3a-41d5-b6fe-5bdcf087c0a0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:57.280537 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d7fcc23-3d3a-41d5-b6fe-5bdcf087c0a0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:57.298707 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-28af7a0b-3810-4079-8016-78db08e67f9c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:57.306886 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-28af7a0b-3810-4079-8016-78db08e67f9c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.177589 Jul 04 09:20:57.307647 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 88/191] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:57 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:57.348678 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d7fcc23-3d3a-41d5-b6fe-5bdcf087c0a0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:57.356967 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5d7fcc23-3d3a-41d5-b6fe-5bdcf087c0a0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1293 microversion: 2.1 time: 0.092354 Jul 04 09:20:57.365075 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 104/192] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:57 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:20:57.878621 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-89d90635-c85f-467c-b4f5-9c8952e2435b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:57.879179 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-89d90635-c85f-467c-b4f5-9c8952e2435b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:57.885760 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-89d90635-c85f-467c-b4f5-9c8952e2435b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:57.886151 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-89d90635-c85f-467c-b4f5-9c8952e2435b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:57.886919 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-89d90635-c85f-467c-b4f5-9c8952e2435b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:57.887369 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-89d90635-c85f-467c-b4f5-9c8952e2435b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:57.912347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-89d90635-c85f-467c-b4f5-9c8952e2435b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/ips" status: 200 len: 152 microversion: 2.20 time: 0.037573 Jul 04 09:20:57.912907 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 89/193] 10.222.0.71 () {60 vars in 1288 bytes} [Mon Jul 4 09:20:57 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:20:58.117341 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-15c772c4-a388-4c66-85fe-a3ebc3aa176e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:58.117965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-15c772c4-a388-4c66-85fe-a3ebc3aa176e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:58.125346 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15c772c4-a388-4c66-85fe-a3ebc3aa176e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:58.125805 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15c772c4-a388-4c66-85fe-a3ebc3aa176e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:58.126581 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15c772c4-a388-4c66-85fe-a3ebc3aa176e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:58.127025 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-15c772c4-a388-4c66-85fe-a3ebc3aa176e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:58.131385 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:20:58.277625 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-15c772c4-a388-4c66-85fe-a3ebc3aa176e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:58.284946 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-15c772c4-a388-4c66-85fe-a3ebc3aa176e tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1504 microversion: 2.1 time: 0.172117 Jul 04 09:20:58.285545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 105/194] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:58 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:58.324895 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d78406ae-d26d-4c98-998d-02a632505e50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:58.325566 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d78406ae-d26d-4c98-998d-02a632505e50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:58.331937 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d78406ae-d26d-4c98-998d-02a632505e50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:58.332425 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d78406ae-d26d-4c98-998d-02a632505e50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:58.333723 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d78406ae-d26d-4c98-998d-02a632505e50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:58.334167 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d78406ae-d26d-4c98-998d-02a632505e50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:58.374752 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7ce0b8c8-93d2-495e-8194-a4d11bed3800 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:58.375365 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7ce0b8c8-93d2-495e-8194-a4d11bed3800 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:58.381610 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ce0b8c8-93d2-495e-8194-a4d11bed3800 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:58.382066 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ce0b8c8-93d2-495e-8194-a4d11bed3800 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:58.382911 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ce0b8c8-93d2-495e-8194-a4d11bed3800 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:58.383354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ce0b8c8-93d2-495e-8194-a4d11bed3800 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:58.455367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7ce0b8c8-93d2-495e-8194-a4d11bed3800 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:58.463994 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7ce0b8c8-93d2-495e-8194-a4d11bed3800 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1301 microversion: 2.1 time: 0.093091 Jul 04 09:20:58.464819 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 106/195] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:58 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:58.490737 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d78406ae-d26d-4c98-998d-02a632505e50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:58.498962 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d78406ae-d26d-4c98-998d-02a632505e50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.177930 Jul 04 09:20:58.499588 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 90/196] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:58 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:59.302062 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff8a8208-b414-4bea-a7e2-8171b4cfb356 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:59.302699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff8a8208-b414-4bea-a7e2-8171b4cfb356 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:59.310024 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff8a8208-b414-4bea-a7e2-8171b4cfb356 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.310477 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff8a8208-b414-4bea-a7e2-8171b4cfb356 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.311237 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff8a8208-b414-4bea-a7e2-8171b4cfb356 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.311675 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff8a8208-b414-4bea-a7e2-8171b4cfb356 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.445328 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff8a8208-b414-4bea-a7e2-8171b4cfb356 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:59.453065 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff8a8208-b414-4bea-a7e2-8171b4cfb356 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1504 microversion: 2.1 time: 0.154863 Jul 04 09:20:59.453644 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 107/197] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:59 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:59.482220 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a0c291d6-8828-400f-9eaf-9812e4e97c39 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:59.482944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a0c291d6-8828-400f-9eaf-9812e4e97c39 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:59.489829 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0c291d6-8828-400f-9eaf-9812e4e97c39 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.490286 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0c291d6-8828-400f-9eaf-9812e4e97c39 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.491282 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0c291d6-8828-400f-9eaf-9812e4e97c39 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.491726 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0c291d6-8828-400f-9eaf-9812e4e97c39 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.515567 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-966427d6-b3f5-4871-90d7-5cdcf08349b4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:20:59.516179 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-966427d6-b3f5-4871-90d7-5cdcf08349b4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:20:59.522155 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-966427d6-b3f5-4871-90d7-5cdcf08349b4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.522610 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-966427d6-b3f5-4871-90d7-5cdcf08349b4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.523384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-966427d6-b3f5-4871-90d7-5cdcf08349b4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:20:59.523824 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-966427d6-b3f5-4871-90d7-5cdcf08349b4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:20:59.553984 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a0c291d6-8828-400f-9eaf-9812e4e97c39 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:59.562111 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a0c291d6-8828-400f-9eaf-9812e4e97c39 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1311 microversion: 2.1 time: 0.084490 Jul 04 09:20:59.562680 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 91/198] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:59 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:20:59.652226 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-966427d6-b3f5-4871-90d7-5cdcf08349b4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:20:59.659743 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-966427d6-b3f5-4871-90d7-5cdcf08349b4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.147976 Jul 04 09:20:59.660353 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 108/199] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:20:59 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:00.234007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ff316ce9-f503-409c-ab53-460bbd1c687e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:00.234538 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ff316ce9-f503-409c-ab53-460bbd1c687e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:00.240597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ff316ce9-f503-409c-ab53-460bbd1c687e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.241066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ff316ce9-f503-409c-ab53-460bbd1c687e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.241835 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ff316ce9-f503-409c-ab53-460bbd1c687e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.242283 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ff316ce9-f503-409c-ab53-460bbd1c687e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.264717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-ff316ce9-f503-409c-ab53-460bbd1c687e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lazy-loading 'flavor' on Instance uuid 9a8dcc08-23ef-46ee-b941-55a7f1716d41 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:21:00.470497 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-31be79a3-06ef-48c6-b5e4-097c75b1cc5f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:00.471727 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-31be79a3-06ef-48c6-b5e4-097c75b1cc5f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:00.481951 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31be79a3-06ef-48c6-b5e4-097c75b1cc5f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.482398 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31be79a3-06ef-48c6-b5e4-097c75b1cc5f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.483168 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31be79a3-06ef-48c6-b5e4-097c75b1cc5f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.483600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31be79a3-06ef-48c6-b5e4-097c75b1cc5f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.593208 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ff316ce9-f503-409c-ab53-460bbd1c687e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "POST /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/action" status: 202 len: 0 microversion: 2.20 time: 0.362940 Jul 04 09:21:00.594373 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 92/200] 10.222.0.71 () {62 vars in 1318 bytes} [Mon Jul 4 09:21:00 2022] POST /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:21:00.599790 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c665fa70-02f5-4f0a-b708-2b3cbd42c5dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:00.600753 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c665fa70-02f5-4f0a-b708-2b3cbd42c5dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:00.607625 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c665fa70-02f5-4f0a-b708-2b3cbd42c5dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.608086 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c665fa70-02f5-4f0a-b708-2b3cbd42c5dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.609082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c665fa70-02f5-4f0a-b708-2b3cbd42c5dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.609703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c665fa70-02f5-4f0a-b708-2b3cbd42c5dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.699326 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c665fa70-02f5-4f0a-b708-2b3cbd42c5dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:00.702414 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-31be79a3-06ef-48c6-b5e4-097c75b1cc5f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:00.707222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c665fa70-02f5-4f0a-b708-2b3cbd42c5dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1299 microversion: 2.1 time: 0.111412 Jul 04 09:21:00.712774 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 93/201] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:00 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:00.712961 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-31be79a3-06ef-48c6-b5e4-097c75b1cc5f tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1504 microversion: 2.1 time: 0.243968 Jul 04 09:21:00.712961 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 109/202] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:00 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:00.713675 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5eb4c999-cb74-4c31-9be5-19e41499c620 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:00.715173 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5eb4c999-cb74-4c31-9be5-19e41499c620 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:00.724426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5eb4c999-cb74-4c31-9be5-19e41499c620 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.724979 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5eb4c999-cb74-4c31-9be5-19e41499c620 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.725713 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5eb4c999-cb74-4c31-9be5-19e41499c620 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.726622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5eb4c999-cb74-4c31-9be5-19e41499c620 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.732356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f824de43-961a-477c-ac91-f38baf3df2ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:00.733322 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f824de43-961a-477c-ac91-f38baf3df2ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:00.741310 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f824de43-961a-477c-ac91-f38baf3df2ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.741934 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f824de43-961a-477c-ac91-f38baf3df2ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.742745 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f824de43-961a-477c-ac91-f38baf3df2ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.743206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f824de43-961a-477c-ac91-f38baf3df2ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:00.946511 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5eb4c999-cb74-4c31-9be5-19e41499c620 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:00.954138 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f824de43-961a-477c-ac91-f38baf3df2ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:00.958210 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5eb4c999-cb74-4c31-9be5-19e41499c620 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:00.964835 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f824de43-961a-477c-ac91-f38baf3df2ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.251380 Jul 04 09:21:00.965108 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5eb4c999-cb74-4c31-9be5-19e41499c620 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:00.966076 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 110/203] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:00 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:00.968292 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5eb4c999-cb74-4c31-9be5-19e41499c620 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.258639 Jul 04 09:21:00.973083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 94/204] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:00 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:00.973216 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3bade322-b8e0-43ee-83f2-d9501d816042 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:00.979779 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3bade322-b8e0-43ee-83f2-d9501d816042 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:00.980237 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3bade322-b8e0-43ee-83f2-d9501d816042 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.043167 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3bade322-b8e0-43ee-83f2-d9501d816042 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Going to try to stop instance {{(pid=117664) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 09:21:01.088106 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3bade322-b8e0-43ee-83f2-d9501d816042 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/action" status: 202 len: 0 microversion: 2.1 time: 0.119807 Jul 04 09:21:01.088889 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 111/205] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:21:00 2022] POST /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:21:01.098049 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-87a68ce9-c923-4beb-93a4-3bd08f658abf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:01.099144 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-87a68ce9-c923-4beb-93a4-3bd08f658abf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:01.106629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87a68ce9-c923-4beb-93a4-3bd08f658abf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.107477 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87a68ce9-c923-4beb-93a4-3bd08f658abf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.108746 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87a68ce9-c923-4beb-93a4-3bd08f658abf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.109486 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87a68ce9-c923-4beb-93a4-3bd08f658abf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.252389 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-87a68ce9-c923-4beb-93a4-3bd08f658abf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:01.261281 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-87a68ce9-c923-4beb-93a4-3bd08f658abf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.167769 Jul 04 09:21:01.261872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 95/206] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:01 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:01.385710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-8bd70648-ce80-49ba-a071-95f0a9ec832e req-ebef18a2-1f49-42f2-9b3b-ab85a06f0a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58438ed-b134-47ca-9d9f-e65c7487e0f4", "name": "network-vif-deleted", "tag": "a26599e8-b391-4bfd-952e-b70478cffdae"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:01.396673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8bd70648-ce80-49ba-a071-95f0a9ec832e req-ebef18a2-1f49-42f2-9b3b-ab85a06f0a11 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.397527 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8bd70648-ce80-49ba-a071-95f0a9ec832e req-ebef18a2-1f49-42f2-9b3b-ab85a06f0a11 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.414020 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-8bd70648-ce80-49ba-a071-95f0a9ec832e req-ebef18a2-1f49-42f2-9b3b-ab85a06f0a11 service nova] Creating event network-vif-deleted:a26599e8-b391-4bfd-952e-b70478cffdae for instance c58438ed-b134-47ca-9d9f-e65c7487e0f4 on hv-cinder-84456 Jul 04 09:21:01.420541 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-8bd70648-ce80-49ba-a071-95f0a9ec832e req-ebef18a2-1f49-42f2-9b3b-ab85a06f0a11 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041901 Jul 04 09:21:01.421304 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 112/207] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:01.728761 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:01.732359 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-457dec09-9e80-4cac-a4eb-b1fd7c07ac21 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:01.733589 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-457dec09-9e80-4cac-a4eb-b1fd7c07ac21 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:01.735905 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:01.743678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-457dec09-9e80-4cac-a4eb-b1fd7c07ac21 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.746985 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-457dec09-9e80-4cac-a4eb-b1fd7c07ac21 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.748165 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.749221 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-457dec09-9e80-4cac-a4eb-b1fd7c07ac21 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.749840 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.750511 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-457dec09-9e80-4cac-a4eb-b1fd7c07ac21 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.752587 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.753238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.944191 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-457dec09-9e80-4cac-a4eb-b1fd7c07ac21 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:01.944775 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.945262 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.946994 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lazy-loading 'fault' on Instance uuid c58438ed-b134-47ca-9d9f-e65c7487e0f4 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:21:01.953665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-457dec09-9e80-4cac-a4eb-b1fd7c07ac21 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1367 microversion: 2.1 time: 0.232150 Jul 04 09:21:01.959928 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 96/208] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:01 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:01.984070 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-385dfec0-b899-4177-83d0-e43b8f8ae7cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:01.985525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-385dfec0-b899-4177-83d0-e43b8f8ae7cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:01.992226 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-385dfec0-b899-4177-83d0-e43b8f8ae7cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.993028 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-385dfec0-b899-4177-83d0-e43b8f8ae7cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:01.994795 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-385dfec0-b899-4177-83d0-e43b8f8ae7cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:01.995342 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:01.995671 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-385dfec0-b899-4177-83d0-e43b8f8ae7cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.003769 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c304ddf3-1763-46f5-9cd2-612720af7d01 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 200 len: 1304 microversion: 2.1 time: 0.279752 Jul 04 09:21:02.004639 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 113/209] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:01 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 1304 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:02.009790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-97f158fa-56c9-4116-8c51-76855e6fd766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:02.010600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-97f158fa-56c9-4116-8c51-76855e6fd766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:02.016982 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-97f158fa-56c9-4116-8c51-76855e6fd766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.017626 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-97f158fa-56c9-4116-8c51-76855e6fd766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.018593 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-97f158fa-56c9-4116-8c51-76855e6fd766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.019111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-97f158fa-56c9-4116-8c51-76855e6fd766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.241062 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-385dfec0-b899-4177-83d0-e43b8f8ae7cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:02.260597 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-97f158fa-56c9-4116-8c51-76855e6fd766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:02.264373 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-385dfec0-b899-4177-83d0-e43b8f8ae7cd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.282581 Jul 04 09:21:02.265023 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 97/210] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:01 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:02.278590 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ebcc7ee0-a773-493b-a4bd-81f84a2c33e4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:02.279219 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ebcc7ee0-a773-493b-a4bd-81f84a2c33e4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:02.279930 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-97f158fa-56c9-4116-8c51-76855e6fd766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:02.281487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-97f158fa-56c9-4116-8c51-76855e6fd766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:02.282668 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-97f158fa-56c9-4116-8c51-76855e6fd766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.277219 Jul 04 09:21:02.283212 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 114/211] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:02 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:02.306512 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ebcc7ee0-a773-493b-a4bd-81f84a2c33e4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.317720 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ebcc7ee0-a773-493b-a4bd-81f84a2c33e4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.318651 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ebcc7ee0-a773-493b-a4bd-81f84a2c33e4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.319111 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ebcc7ee0-a773-493b-a4bd-81f84a2c33e4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.489918 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ebcc7ee0-a773-493b-a4bd-81f84a2c33e4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:02.499412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ebcc7ee0-a773-493b-a4bd-81f84a2c33e4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.224644 Jul 04 09:21:02.500775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 98/212] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:02 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:02.971357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-95acb210-b0ee-470d-b362-db4e0e9523c1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:02.971980 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-95acb210-b0ee-470d-b362-db4e0e9523c1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:02.979074 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95acb210-b0ee-470d-b362-db4e0e9523c1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.979533 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95acb210-b0ee-470d-b362-db4e0e9523c1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:02.980318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95acb210-b0ee-470d-b362-db4e0e9523c1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:02.980757 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95acb210-b0ee-470d-b362-db4e0e9523c1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.022420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-573858fb-8adb-446d-ac13-4e33da6d21d2 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:03.023038 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-573858fb-8adb-446d-ac13-4e33da6d21d2 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: c58438ed-b134-47ca-9d9f-e65c7487e0f4] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:03.030660 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-573858fb-8adb-446d-ac13-4e33da6d21d2 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.031119 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-573858fb-8adb-446d-ac13-4e33da6d21d2 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.031896 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-573858fb-8adb-446d-ac13-4e33da6d21d2 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.032339 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-573858fb-8adb-446d-ac13-4e33da6d21d2 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.047543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-573858fb-8adb-446d-ac13-4e33da6d21d2 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] HTTP exception thrown: Instance c58438ed-b134-47ca-9d9f-e65c7487e0f4 could not be found. Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-573858fb-8adb-446d-ac13-4e33da6d21d2 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Request method failure captured: Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 HTTP/1.1 Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrDpxId8J8AJlvhsG9e-EYUqJqcV1HVSLf7XpYVHjCmD6sMoA-BsMZ94Zl3OLqiy-685KnTjXUN1nQt3qCegIDG2GLprgJYvvBy1fdkU0wYrnaIHUTVbm5U_WIeGvosI8rO78GT2DtgPLNKK2iNPZBJddiggdQl8GmnA6s8pPy0YsUc Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: d6ecddd48b9a466880e0288edd65ce0a Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesActionsTest-648851749 Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:21:03.049390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d6ecddd48b9a466880e0288edd65ce0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d6ecddd48b9a466880e0288edd65ce0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d6ecddd48b9a466880e0288edd65ce0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d6ecddd48b9a466880e0288edd65ce0a", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesActionsTest-648851749 Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: d6ecddd48b9a466880e0288edd65ce0a Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesActionsTest-648851749 Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesActionsTest-648851749-project Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 44e20abe50c041c0b52d788b1cb237fe Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesActionsTest-648851749-project Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance c58438ed-b134-47ca-9d9f-e65c7487e0f4 could not be found. Jul 04 09:21:03.050692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': 'c58438ed-b134-47ca-9d9f-e65c7487e0f4'} Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c58438ed-b134-47ca-9d9f-e65c7487e0f4 could not be found. Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:21:03.051397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c58438ed-b134-47ca-9d9f-e65c7487e0f4 could not be found. Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c58438ed-b134-47ca-9d9f-e65c7487e0f4 could not be found. Jul 04 09:21:03.053299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:21:03.055048 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-573858fb-8adb-446d-ac13-4e33da6d21d2 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Returning 404 to user: Instance c58438ed-b134-47ca-9d9f-e65c7487e0f4 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:21:03.055048 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-573858fb-8adb-446d-ac13-4e33da6d21d2 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4" status: 404 len: 111 microversion: 2.1 time: 0.032177 Jul 04 09:21:03.055048 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 99/213] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:03 2022] GET /compute/v2.1/servers/c58438ed-b134-47ca-9d9f-e65c7487e0f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:21:03.103040 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-702727666", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "networks": [{"uuid": "b2b6be8b-cc07-42e4-b64d-bbd2e36617c1"}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:03.146890 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-95acb210-b0ee-470d-b362-db4e0e9523c1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:03.165117 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-95acb210-b0ee-470d-b362-db4e0e9523c1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1367 microversion: 2.1 time: 0.197343 Jul 04 09:21:03.165889 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] validate_networks() for [('b2b6be8b-cc07-42e4-b64d-bbd2e36617c1', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:21:03.166454 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 115/214] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:02 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:03.282261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f7230132-7c53-414c-8fb1-9b8cc768fc4c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:03.283128 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f7230132-7c53-414c-8fb1-9b8cc768fc4c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:03.289591 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7230132-7c53-414c-8fb1-9b8cc768fc4c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.290087 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7230132-7c53-414c-8fb1-9b8cc768fc4c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.290865 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7230132-7c53-414c-8fb1-9b8cc768fc4c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.291305 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7230132-7c53-414c-8fb1-9b8cc768fc4c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.514134 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f7230132-7c53-414c-8fb1-9b8cc768fc4c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:03.522041 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f7230132-7c53-414c-8fb1-9b8cc768fc4c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.244032 Jul 04 09:21:03.522611 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 116/215] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:03 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:03.535735 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-93115970-6f4b-417e-b9d7-c70b61f37dc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:03.536275 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-93115970-6f4b-417e-b9d7-c70b61f37dc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:03.542178 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-93115970-6f4b-417e-b9d7-c70b61f37dc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.542635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-93115970-6f4b-417e-b9d7-c70b61f37dc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.543410 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-93115970-6f4b-417e-b9d7-c70b61f37dc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.543859 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-93115970-6f4b-417e-b9d7-c70b61f37dc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.645753 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:21:03.646250 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:21:03.646794 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:21:03.647308 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:21:03.647820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:21:03.657188 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.657723 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.658629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.659179 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.676082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Getting quotas for project d6ecddd48b9a466880e0288edd65ce0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:21:03.680059 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Getting quotas for user 44e20abe50c041c0b52d788b1cb237fe and project d6ecddd48b9a466880e0288edd65ce0a. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:21:03.691445 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-93115970-6f4b-417e-b9d7-c70b61f37dc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:03.693064 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:21:03.695653 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:21:03.701506 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-93115970-6f4b-417e-b9d7-c70b61f37dc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:03.703143 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-93115970-6f4b-417e-b9d7-c70b61f37dc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:03.704442 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-93115970-6f4b-417e-b9d7-c70b61f37dc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.172443 Jul 04 09:21:03.709356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 117/216] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:03 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:03.709713 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-f5302d35-a5ca-4d3e-92f6-44194bfd60a2 req-b62d8ec7-ca20-4246-9ea8-73ce518c3be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e", "tag": "4342135f-47ac-4111-90c5-e5c2887b2f02"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:03.718380 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-f5302d35-a5ca-4d3e-92f6-44194bfd60a2 req-b62d8ec7-ca20-4246-9ea8-73ce518c3be1 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.718931 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-f5302d35-a5ca-4d3e-92f6-44194bfd60a2 req-b62d8ec7-ca20-4246-9ea8-73ce518c3be1 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.731317 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-f5302d35-a5ca-4d3e-92f6-44194bfd60a2 req-b62d8ec7-ca20-4246-9ea8-73ce518c3be1 service nova] Creating event network-changed:4342135f-47ac-4111-90c5-e5c2887b2f02 for instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e on hv-cinder-84456 Jul 04 09:21:03.736609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-f5302d35-a5ca-4d3e-92f6-44194bfd60a2 req-b62d8ec7-ca20-4246-9ea8-73ce518c3be1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030198 Jul 04 09:21:03.737888 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 118/217] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:03.744728 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9d29b6f4-9cf4-4115-af01-4cdcb7f39236 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:03.745541 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9d29b6f4-9cf4-4115-af01-4cdcb7f39236 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:03.751812 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d29b6f4-9cf4-4115-af01-4cdcb7f39236 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.752290 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d29b6f4-9cf4-4115-af01-4cdcb7f39236 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.753081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d29b6f4-9cf4-4115-af01-4cdcb7f39236 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.753526 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d29b6f4-9cf4-4115-af01-4cdcb7f39236 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.757862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-af65d86c-0bf4-40c7-866b-617c6d9aa1ed tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658742 Jul 04 09:21:03.758514 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 100/218] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:21:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 09:21:03.763658 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b2b35585-9c2e-4166-b3e5-b22ea45fc599 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a739683d-8757-42c1-a060-e1811acd68cc", "device": "/dev/sdb"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:03.765339 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b2b35585-9c2e-4166-b3e5-b22ea45fc599 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:03.771404 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2b35585-9c2e-4166-b3e5-b22ea45fc599 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.771861 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2b35585-9c2e-4166-b3e5-b22ea45fc599 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.772632 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2b35585-9c2e-4166-b3e5-b22ea45fc599 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:03.773980 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2b35585-9c2e-4166-b3e5-b22ea45fc599 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:03.793543 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=24 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:03.908588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9d29b6f4-9cf4-4115-af01-4cdcb7f39236 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:03.916848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9d29b6f4-9cf4-4115-af01-4cdcb7f39236 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.178073 Jul 04 09:21:03.917444 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 119/219] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:03 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:03.922030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-32933031-5303-4715-a05f-7433dfe5c604 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:03.922642 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-32933031-5303-4715-a05f-7433dfe5c604 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:03.976609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-32933031-5303-4715-a05f-7433dfe5c604 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:03.984241 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-32933031-5303-4715-a05f-7433dfe5c604 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1213 microversion: 2.1 time: 0.065740 Jul 04 09:21:03.984739 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 120/220] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:03 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:04.106189 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:04.191989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5f6480d9-618b-43c0-997c-0d2530cf1f81 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:04.192615 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5f6480d9-618b-43c0-997c-0d2530cf1f81 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:04.201422 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f6480d9-618b-43c0-997c-0d2530cf1f81 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.201925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f6480d9-618b-43c0-997c-0d2530cf1f81 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.202719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f6480d9-618b-43c0-997c-0d2530cf1f81 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.203164 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5f6480d9-618b-43c0-997c-0d2530cf1f81 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.261634 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b2b35585-9c2e-4166-b3e5-b22ea45fc599 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "POST /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501371 Jul 04 09:21:04.263294 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 101/221] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:21:03 2022] POST /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:04.380143 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5f6480d9-618b-43c0-997c-0d2530cf1f81 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:04.392767 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5f6480d9-618b-43c0-997c-0d2530cf1f81 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1367 microversion: 2.1 time: 0.205601 Jul 04 09:21:04.398045 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 121/222] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:04 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:04.538892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4be1ec71-9833-4ab3-b276-4c648664c15f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:04.539797 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4be1ec71-9833-4ab3-b276-4c648664c15f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:04.547604 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4be1ec71-9833-4ab3-b276-4c648664c15f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.548061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4be1ec71-9833-4ab3-b276-4c648664c15f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.548847 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4be1ec71-9833-4ab3-b276-4c648664c15f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.549310 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4be1ec71-9833-4ab3-b276-4c648664c15f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.684615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4be1ec71-9833-4ab3-b276-4c648664c15f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:04.692373 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4be1ec71-9833-4ab3-b276-4c648664c15f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.157684 Jul 04 09:21:04.692939 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 102/223] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:04 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:04.723355 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e6032260-4a26-4c07-9600-146f1e5a4e0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:04.723965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e6032260-4a26-4c07-9600-146f1e5a4e0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:04.730587 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e6032260-4a26-4c07-9600-146f1e5a4e0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.731033 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e6032260-4a26-4c07-9600-146f1e5a4e0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.731788 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e6032260-4a26-4c07-9600-146f1e5a4e0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.732271 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e6032260-4a26-4c07-9600-146f1e5a4e0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.890603 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e6032260-4a26-4c07-9600-146f1e5a4e0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:04.892900 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:04.900498 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e6032260-4a26-4c07-9600-146f1e5a4e0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:04.902170 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e6032260-4a26-4c07-9600-146f1e5a4e0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:04.903549 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e6032260-4a26-4c07-9600-146f1e5a4e0c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.184198 Jul 04 09:21:04.904101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 122/224] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:04 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:04.935284 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6cfb0d98-d02f-47cf-912a-1e8af385713b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:04.936052 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6cfb0d98-d02f-47cf-912a-1e8af385713b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:04.938000 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:04.943793 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6cfb0d98-d02f-47cf-912a-1e8af385713b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.944244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6cfb0d98-d02f-47cf-912a-1e8af385713b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:04.945016 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6cfb0d98-d02f-47cf-912a-1e8af385713b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:04.945647 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6cfb0d98-d02f-47cf-912a-1e8af385713b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.001763 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7f594e44-6281-4f03-905f-f794285a7a46 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:05.002495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7f594e44-6281-4f03-905f-f794285a7a46 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:05.010353 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f594e44-6281-4f03-905f-f794285a7a46 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.013359 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f594e44-6281-4f03-905f-f794285a7a46 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.015923 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f594e44-6281-4f03-905f-f794285a7a46 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.017906 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f594e44-6281-4f03-905f-f794285a7a46 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.115497 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7f594e44-6281-4f03-905f-f794285a7a46 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:05.127048 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7f594e44-6281-4f03-905f-f794285a7a46 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1283 microversion: 2.1 time: 0.128987 Jul 04 09:21:05.129570 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 123/225] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:04 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1283 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:05.148937 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6cfb0d98-d02f-47cf-912a-1e8af385713b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:05.159909 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6cfb0d98-d02f-47cf-912a-1e8af385713b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.229316 Jul 04 09:21:05.160946 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 103/226] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:04 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:05.410777 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c48b18ba-953f-4ad8-ab53-c61dde9c5ed7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:05.411393 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c48b18ba-953f-4ad8-ab53-c61dde9c5ed7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:05.418415 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c48b18ba-953f-4ad8-ab53-c61dde9c5ed7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.418868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c48b18ba-953f-4ad8-ab53-c61dde9c5ed7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.419652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c48b18ba-953f-4ad8-ab53-c61dde9c5ed7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.420094 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c48b18ba-953f-4ad8-ab53-c61dde9c5ed7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.554412 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c48b18ba-953f-4ad8-ab53-c61dde9c5ed7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:05.562423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c48b18ba-953f-4ad8-ab53-c61dde9c5ed7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1367 microversion: 2.1 time: 0.155880 Jul 04 09:21:05.563002 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 124/227] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:05 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:05.712640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4f82fcd1-b457-4a90-b7ec-d145cb141f5f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:05.713537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4f82fcd1-b457-4a90-b7ec-d145cb141f5f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:05.721491 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f82fcd1-b457-4a90-b7ec-d145cb141f5f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.722056 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f82fcd1-b457-4a90-b7ec-d145cb141f5f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.722936 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f82fcd1-b457-4a90-b7ec-d145cb141f5f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.723516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f82fcd1-b457-4a90-b7ec-d145cb141f5f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.922519 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-096414b1-8c0d-4a66-a71d-8a3eca65e2af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:05.923941 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-096414b1-8c0d-4a66-a71d-8a3eca65e2af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:05.929919 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-096414b1-8c0d-4a66-a71d-8a3eca65e2af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.930980 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-096414b1-8c0d-4a66-a71d-8a3eca65e2af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:05.931955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-096414b1-8c0d-4a66-a71d-8a3eca65e2af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:05.932401 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-096414b1-8c0d-4a66-a71d-8a3eca65e2af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.036485 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4f82fcd1-b457-4a90-b7ec-d145cb141f5f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:06.044618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4f82fcd1-b457-4a90-b7ec-d145cb141f5f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.338482 Jul 04 09:21:06.053069 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 104/228] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:05 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:06.100777 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-096414b1-8c0d-4a66-a71d-8a3eca65e2af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:06.110059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-096414b1-8c0d-4a66-a71d-8a3eca65e2af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:06.111579 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-096414b1-8c0d-4a66-a71d-8a3eca65e2af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:06.112752 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-096414b1-8c0d-4a66-a71d-8a3eca65e2af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.194307 Jul 04 09:21:06.113344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 125/229] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:05 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:06.147294 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fa492cc3-3905-45b5-a237-a6f9640492bf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:06.148092 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fa492cc3-3905-45b5-a237-a6f9640492bf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:06.154493 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa492cc3-3905-45b5-a237-a6f9640492bf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.155134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa492cc3-3905-45b5-a237-a6f9640492bf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.155741 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa492cc3-3905-45b5-a237-a6f9640492bf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.156183 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa492cc3-3905-45b5-a237-a6f9640492bf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.178600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-80a45adb-04bd-41c8-a6a9-6c5ca7926d05 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:06.179441 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-80a45adb-04bd-41c8-a6a9-6c5ca7926d05 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:06.187500 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-80a45adb-04bd-41c8-a6a9-6c5ca7926d05 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.187949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-80a45adb-04bd-41c8-a6a9-6c5ca7926d05 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.188724 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-80a45adb-04bd-41c8-a6a9-6c5ca7926d05 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.189371 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-80a45adb-04bd-41c8-a6a9-6c5ca7926d05 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.348388 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa492cc3-3905-45b5-a237-a6f9640492bf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:06.358720 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fa492cc3-3905-45b5-a237-a6f9640492bf tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1313 microversion: 2.1 time: 0.214025 Jul 04 09:21:06.359461 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 105/230] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:06 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:06.372552 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-80a45adb-04bd-41c8-a6a9-6c5ca7926d05 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:06.380602 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-80a45adb-04bd-41c8-a6a9-6c5ca7926d05 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.206969 Jul 04 09:21:06.393314 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 126/231] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:06 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:06.480456 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-e6f9d2be-47a0-4015-9842-fe66596f6097 req-23559499-0c80-4a7c-8c8f-f8bffa2950b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349ad723-ae6f-40a6-b6db-5235354bf944", "tag": "c5821c99-df05-4919-b01e-057f4fd3b47a"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:06.488661 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-e6f9d2be-47a0-4015-9842-fe66596f6097 req-23559499-0c80-4a7c-8c8f-f8bffa2950b1 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.489114 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-e6f9d2be-47a0-4015-9842-fe66596f6097 req-23559499-0c80-4a7c-8c8f-f8bffa2950b1 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.500156 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-e6f9d2be-47a0-4015-9842-fe66596f6097 req-23559499-0c80-4a7c-8c8f-f8bffa2950b1 service nova] Creating event network-changed:c5821c99-df05-4919-b01e-057f4fd3b47a for instance 349ad723-ae6f-40a6-b6db-5235354bf944 on hv-cinder-84456 Jul 04 09:21:06.505843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-e6f9d2be-47a0-4015-9842-fe66596f6097 req-23559499-0c80-4a7c-8c8f-f8bffa2950b1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029660 Jul 04 09:21:06.506758 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 106/232] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:06.580294 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-61cf76cc-2216-4689-88f7-4c9bafef58d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:06.580912 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-61cf76cc-2216-4689-88f7-4c9bafef58d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:06.588233 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-61cf76cc-2216-4689-88f7-4c9bafef58d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.588880 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-61cf76cc-2216-4689-88f7-4c9bafef58d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.590279 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-61cf76cc-2216-4689-88f7-4c9bafef58d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:06.590819 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-61cf76cc-2216-4689-88f7-4c9bafef58d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:06.725152 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-61cf76cc-2216-4689-88f7-4c9bafef58d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:06.733343 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-61cf76cc-2216-4689-88f7-4c9bafef58d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1367 microversion: 2.1 time: 0.157068 Jul 04 09:21:06.734100 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 127/233] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:06 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:07.062697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b0623a8e-3ab9-42b2-8f42-cd0ed1f16d8f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:07.063515 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b0623a8e-3ab9-42b2-8f42-cd0ed1f16d8f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:07.070182 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0623a8e-3ab9-42b2-8f42-cd0ed1f16d8f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.070728 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0623a8e-3ab9-42b2-8f42-cd0ed1f16d8f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.072082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0623a8e-3ab9-42b2-8f42-cd0ed1f16d8f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.072525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0623a8e-3ab9-42b2-8f42-cd0ed1f16d8f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.131502 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cdf644fa-9aa7-4635-80d9-7a4b5508d989 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:07.132129 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cdf644fa-9aa7-4635-80d9-7a4b5508d989 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:07.140672 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdf644fa-9aa7-4635-80d9-7a4b5508d989 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.141072 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdf644fa-9aa7-4635-80d9-7a4b5508d989 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.141888 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdf644fa-9aa7-4635-80d9-7a4b5508d989 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.142338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cdf644fa-9aa7-4635-80d9-7a4b5508d989 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.246810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b0623a8e-3ab9-42b2-8f42-cd0ed1f16d8f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:07.254490 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b0623a8e-3ab9-42b2-8f42-cd0ed1f16d8f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.196496 Jul 04 09:21:07.255145 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 107/234] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:07 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:07.260634 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-7966b941-5c25-45fa-8b26-2bd1994edef6 req-cb2819cd-3f57-4a7f-a7e6-038bd0cfcabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e", "name": "network-vif-plugged", "status": "completed", "tag": "4342135f-47ac-4111-90c5-e5c2887b2f02"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:07.269248 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-7966b941-5c25-45fa-8b26-2bd1994edef6 req-cb2819cd-3f57-4a7f-a7e6-038bd0cfcabc service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.269691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-7966b941-5c25-45fa-8b26-2bd1994edef6 req-cb2819cd-3f57-4a7f-a7e6-038bd0cfcabc service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.281127 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-7966b941-5c25-45fa-8b26-2bd1994edef6 req-cb2819cd-3f57-4a7f-a7e6-038bd0cfcabc service nova] Creating event network-vif-plugged:4342135f-47ac-4111-90c5-e5c2887b2f02 for instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e on hv-cinder-84456 Jul 04 09:21:07.286178 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-7966b941-5c25-45fa-8b26-2bd1994edef6 req-cb2819cd-3f57-4a7f-a7e6-038bd0cfcabc service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029803 Jul 04 09:21:07.286849 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 108/235] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:07.311360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cdf644fa-9aa7-4635-80d9-7a4b5508d989 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:07.319241 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cdf644fa-9aa7-4635-80d9-7a4b5508d989 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:07.320738 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cdf644fa-9aa7-4635-80d9-7a4b5508d989 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:07.322677 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cdf644fa-9aa7-4635-80d9-7a4b5508d989 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.195602 Jul 04 09:21:07.323233 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 128/236] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:07 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:07.375723 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bd77bc04-c2b5-48d5-811d-292e51ff0a05 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:07.376430 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bd77bc04-c2b5-48d5-811d-292e51ff0a05 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:07.382869 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bd77bc04-c2b5-48d5-811d-292e51ff0a05 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.383332 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bd77bc04-c2b5-48d5-811d-292e51ff0a05 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.384769 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bd77bc04-c2b5-48d5-811d-292e51ff0a05 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.385276 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bd77bc04-c2b5-48d5-811d-292e51ff0a05 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.398266 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a3ee4688-0e2a-4840-9d95-97d0e6ba40f4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:07.398886 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a3ee4688-0e2a-4840-9d95-97d0e6ba40f4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:07.400733 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:07.406105 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3ee4688-0e2a-4840-9d95-97d0e6ba40f4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.406553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3ee4688-0e2a-4840-9d95-97d0e6ba40f4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.407319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3ee4688-0e2a-4840-9d95-97d0e6ba40f4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.407752 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a3ee4688-0e2a-4840-9d95-97d0e6ba40f4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.586753 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a3ee4688-0e2a-4840-9d95-97d0e6ba40f4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:07.590720 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-bd77bc04-c2b5-48d5-811d-292e51ff0a05 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:07.595190 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a3ee4688-0e2a-4840-9d95-97d0e6ba40f4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.200726 Jul 04 09:21:07.595760 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 129/237] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:07 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:07.598279 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bd77bc04-c2b5-48d5-811d-292e51ff0a05 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1313 microversion: 2.1 time: 0.226718 Jul 04 09:21:07.598835 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 109/238] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:07 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:07.750282 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d6507af8-663d-4960-8a8b-4db2b03f5360 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:07.750826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d6507af8-663d-4960-8a8b-4db2b03f5360 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:07.757060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6507af8-663d-4960-8a8b-4db2b03f5360 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.757527 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6507af8-663d-4960-8a8b-4db2b03f5360 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.758284 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6507af8-663d-4960-8a8b-4db2b03f5360 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:07.758881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d6507af8-663d-4960-8a8b-4db2b03f5360 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:07.887179 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d6507af8-663d-4960-8a8b-4db2b03f5360 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:07.894620 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d6507af8-663d-4960-8a8b-4db2b03f5360 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1367 microversion: 2.1 time: 0.148229 Jul 04 09:21:07.895211 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 130/239] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:07 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:08.271716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1723e55d-263e-4421-a2f8-c7f822c95647 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:08.272334 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1723e55d-263e-4421-a2f8-c7f822c95647 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:08.279964 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1723e55d-263e-4421-a2f8-c7f822c95647 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.280415 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1723e55d-263e-4421-a2f8-c7f822c95647 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.281243 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1723e55d-263e-4421-a2f8-c7f822c95647 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.281687 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1723e55d-263e-4421-a2f8-c7f822c95647 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.340711 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c43e863f-51de-4497-9ff8-07b473b9f8ac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:08.341482 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c43e863f-51de-4497-9ff8-07b473b9f8ac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:08.348416 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c43e863f-51de-4497-9ff8-07b473b9f8ac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.348890 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c43e863f-51de-4497-9ff8-07b473b9f8ac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.349722 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c43e863f-51de-4497-9ff8-07b473b9f8ac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.350159 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c43e863f-51de-4497-9ff8-07b473b9f8ac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.637431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1723e55d-263e-4421-a2f8-c7f822c95647 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:08.645692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1723e55d-263e-4421-a2f8-c7f822c95647 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.377809 Jul 04 09:21:08.646363 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 110/240] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:08 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:08.651119 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d69beb68-34c3-40d3-b667-de918deefb47 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:08.651726 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d69beb68-34c3-40d3-b667-de918deefb47 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:08.657960 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d69beb68-34c3-40d3-b667-de918deefb47 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.658481 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d69beb68-34c3-40d3-b667-de918deefb47 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.659202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d69beb68-34c3-40d3-b667-de918deefb47 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.659640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d69beb68-34c3-40d3-b667-de918deefb47 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.682759 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c43e863f-51de-4497-9ff8-07b473b9f8ac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:08.691026 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c43e863f-51de-4497-9ff8-07b473b9f8ac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:08.692932 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c43e863f-51de-4497-9ff8-07b473b9f8ac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:08.694449 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c43e863f-51de-4497-9ff8-07b473b9f8ac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.358534 Jul 04 09:21:08.695001 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 131/241] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:08 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:08.700143 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-054bd6fa-c962-4d08-8bb1-641082939365 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:08.700937 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-054bd6fa-c962-4d08-8bb1-641082939365 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:08.707084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-054bd6fa-c962-4d08-8bb1-641082939365 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.707737 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-054bd6fa-c962-4d08-8bb1-641082939365 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.708666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-054bd6fa-c962-4d08-8bb1-641082939365 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.709277 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-054bd6fa-c962-4d08-8bb1-641082939365 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.844475 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d69beb68-34c3-40d3-b667-de918deefb47 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:08.852677 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d69beb68-34c3-40d3-b667-de918deefb47 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.205158 Jul 04 09:21:08.853825 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 111/242] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:08 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:08.873624 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-054bd6fa-c962-4d08-8bb1-641082939365 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:08.881130 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-054bd6fa-c962-4d08-8bb1-641082939365 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1313 microversion: 2.1 time: 0.184937 Jul 04 09:21:08.881714 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 132/243] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:08 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:08.911488 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-98ad7a49-f971-4f28-8e89-128562481ea5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:08.912101 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-98ad7a49-f971-4f28-8e89-128562481ea5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:08.918284 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98ad7a49-f971-4f28-8e89-128562481ea5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.918738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98ad7a49-f971-4f28-8e89-128562481ea5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:08.919503 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98ad7a49-f971-4f28-8e89-128562481ea5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:08.919942 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98ad7a49-f971-4f28-8e89-128562481ea5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:09.047360 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-98ad7a49-f971-4f28-8e89-128562481ea5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:09.054955 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-98ad7a49-f971-4f28-8e89-128562481ea5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1367 microversion: 2.1 time: 0.147276 Jul 04 09:21:09.055511 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 112/244] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:08 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:09.662710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-552917c6-eaa0-43a2-965a-3b96bb30c2a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:09.663324 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-552917c6-eaa0-43a2-965a-3b96bb30c2a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:09.670564 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-552917c6-eaa0-43a2-965a-3b96bb30c2a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:09.671003 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-552917c6-eaa0-43a2-965a-3b96bb30c2a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:09.671764 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-552917c6-eaa0-43a2-965a-3b96bb30c2a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:09.672202 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-552917c6-eaa0-43a2-965a-3b96bb30c2a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:09.720002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-53d367a4-00fd-404f-a8cb-b1e0a960529d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:09.720829 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-53d367a4-00fd-404f-a8cb-b1e0a960529d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:09.727326 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d367a4-00fd-404f-a8cb-b1e0a960529d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:09.727596 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d367a4-00fd-404f-a8cb-b1e0a960529d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:09.729226 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d367a4-00fd-404f-a8cb-b1e0a960529d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:09.729352 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d367a4-00fd-404f-a8cb-b1e0a960529d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:09.866960 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-552917c6-eaa0-43a2-965a-3b96bb30c2a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:09.874386 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-552917c6-eaa0-43a2-965a-3b96bb30c2a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.215623 Jul 04 09:21:09.874955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 133/245] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:09 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:09.879354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-21cbbc5b-1f59-465d-b1a3-6ee23641e7b5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:09.879961 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-21cbbc5b-1f59-465d-b1a3-6ee23641e7b5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:09.886397 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21cbbc5b-1f59-465d-b1a3-6ee23641e7b5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:09.886856 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21cbbc5b-1f59-465d-b1a3-6ee23641e7b5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:09.887623 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21cbbc5b-1f59-465d-b1a3-6ee23641e7b5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:09.888063 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-21cbbc5b-1f59-465d-b1a3-6ee23641e7b5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:09.894216 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-53d367a4-00fd-404f-a8cb-b1e0a960529d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:09.903045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-53d367a4-00fd-404f-a8cb-b1e0a960529d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:09.904572 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-53d367a4-00fd-404f-a8cb-b1e0a960529d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:09.905776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-53d367a4-00fd-404f-a8cb-b1e0a960529d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.196022 Jul 04 09:21:09.906341 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 113/246] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:09 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:09.912530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cd105739-95e3-46d9-8f0c-4a1e2a19e6a9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:09.913103 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cd105739-95e3-46d9-8f0c-4a1e2a19e6a9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:09.919840 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd105739-95e3-46d9-8f0c-4a1e2a19e6a9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:09.920301 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd105739-95e3-46d9-8f0c-4a1e2a19e6a9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:09.921101 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd105739-95e3-46d9-8f0c-4a1e2a19e6a9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:09.921551 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd105739-95e3-46d9-8f0c-4a1e2a19e6a9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:10.068335 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-21cbbc5b-1f59-465d-b1a3-6ee23641e7b5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:10.076798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-21cbbc5b-1f59-465d-b1a3-6ee23641e7b5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.200884 Jul 04 09:21:10.077395 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 134/247] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:09 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:10.081951 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-779e457f-63d6-4bae-87df-954889783f02 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:10.083212 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-779e457f-63d6-4bae-87df-954889783f02 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:10.090158 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779e457f-63d6-4bae-87df-954889783f02 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:10.090609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779e457f-63d6-4bae-87df-954889783f02 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:10.091379 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779e457f-63d6-4bae-87df-954889783f02 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:10.091816 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-779e457f-63d6-4bae-87df-954889783f02 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:10.095240 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cd105739-95e3-46d9-8f0c-4a1e2a19e6a9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:10.102759 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cd105739-95e3-46d9-8f0c-4a1e2a19e6a9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1313 microversion: 2.1 time: 0.195460 Jul 04 09:21:10.103541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 114/248] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:09 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:10.222603 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-779e457f-63d6-4bae-87df-954889783f02 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:10.230331 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-779e457f-63d6-4bae-87df-954889783f02 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1367 microversion: 2.1 time: 0.151971 Jul 04 09:21:10.230903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 135/249] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:10 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:10.891274 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1ab465e1-3def-45ca-a5ce-7b62e45d313d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:10.891888 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1ab465e1-3def-45ca-a5ce-7b62e45d313d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:10.898463 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ab465e1-3def-45ca-a5ce-7b62e45d313d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:10.898924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ab465e1-3def-45ca-a5ce-7b62e45d313d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:10.899694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ab465e1-3def-45ca-a5ce-7b62e45d313d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:10.900630 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ab465e1-3def-45ca-a5ce-7b62e45d313d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:10.924026 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9a89115d-b029-442f-82cc-ecb02007728c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:10.924892 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9a89115d-b029-442f-82cc-ecb02007728c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:10.932004 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9a89115d-b029-442f-82cc-ecb02007728c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:10.932617 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9a89115d-b029-442f-82cc-ecb02007728c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:10.933625 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9a89115d-b029-442f-82cc-ecb02007728c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:10.934231 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9a89115d-b029-442f-82cc-ecb02007728c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.078653 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1ab465e1-3def-45ca-a5ce-7b62e45d313d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:11.086762 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1ab465e1-3def-45ca-a5ce-7b62e45d313d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.199304 Jul 04 09:21:11.088861 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 115/250] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:10 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:11.094618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8918be16-99c9-4042-a7db-91a82a8f77bf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:11.095491 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8918be16-99c9-4042-a7db-91a82a8f77bf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:11.102100 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8918be16-99c9-4042-a7db-91a82a8f77bf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.102674 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8918be16-99c9-4042-a7db-91a82a8f77bf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.104869 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8918be16-99c9-4042-a7db-91a82a8f77bf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.105432 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8918be16-99c9-4042-a7db-91a82a8f77bf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.120689 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9a89115d-b029-442f-82cc-ecb02007728c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:11.129927 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9a89115d-b029-442f-82cc-ecb02007728c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:11.131715 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9a89115d-b029-442f-82cc-ecb02007728c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:11.133352 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9a89115d-b029-442f-82cc-ecb02007728c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.213005 Jul 04 09:21:11.134093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 136/251] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:10 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:11.142636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fb2c23c1-5760-4d56-9128-76778664a693 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:11.143259 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fb2c23c1-5760-4d56-9128-76778664a693 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:11.150295 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb2c23c1-5760-4d56-9128-76778664a693 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.151900 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb2c23c1-5760-4d56-9128-76778664a693 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.152664 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb2c23c1-5760-4d56-9128-76778664a693 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.153199 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb2c23c1-5760-4d56-9128-76778664a693 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.300313 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8918be16-99c9-4042-a7db-91a82a8f77bf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:11.311908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8918be16-99c9-4042-a7db-91a82a8f77bf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.220890 Jul 04 09:21:11.312493 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 116/252] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:11 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:11.316886 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-d2b06e06-e7a9-4ff7-bc78-9eddf24897cf req-5c5276d8-a943-4799-b83e-3a008e2053ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349ad723-ae6f-40a6-b6db-5235354bf944", "name": "network-vif-plugged", "status": "completed", "tag": "c5821c99-df05-4919-b01e-057f4fd3b47a"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:11.325862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-d2b06e06-e7a9-4ff7-bc78-9eddf24897cf req-5c5276d8-a943-4799-b83e-3a008e2053ee service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.326303 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-d2b06e06-e7a9-4ff7-bc78-9eddf24897cf req-5c5276d8-a943-4799-b83e-3a008e2053ee service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.332404 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fb2c23c1-5760-4d56-9128-76778664a693 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:11.337394 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-d2b06e06-e7a9-4ff7-bc78-9eddf24897cf req-5c5276d8-a943-4799-b83e-3a008e2053ee service nova] Creating event network-vif-plugged:c5821c99-df05-4919-b01e-057f4fd3b47a for instance 349ad723-ae6f-40a6-b6db-5235354bf944 on hv-cinder-84456 Jul 04 09:21:11.341114 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fb2c23c1-5760-4d56-9128-76778664a693 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1313 microversion: 2.1 time: 0.205101 Jul 04 09:21:11.341680 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 137/253] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:11 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:11.343810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-d2b06e06-e7a9-4ff7-bc78-9eddf24897cf req-5c5276d8-a943-4799-b83e-3a008e2053ee service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030214 Jul 04 09:21:11.344382 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 117/254] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:11.346568 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c743ae34-2014-4300-93ca-47bf10c93aef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:11.347118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c743ae34-2014-4300-93ca-47bf10c93aef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:11.352977 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c743ae34-2014-4300-93ca-47bf10c93aef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.353631 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c743ae34-2014-4300-93ca-47bf10c93aef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.354228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c743ae34-2014-4300-93ca-47bf10c93aef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.354662 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c743ae34-2014-4300-93ca-47bf10c93aef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.488977 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c743ae34-2014-4300-93ca-47bf10c93aef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:11.496678 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c743ae34-2014-4300-93ca-47bf10c93aef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1556 microversion: 2.1 time: 0.154057 Jul 04 09:21:11.497280 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 138/255] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:11 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:11.515944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dc7de893-247f-4c22-8276-7e1f8d0cfe89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:11.516524 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dc7de893-247f-4c22-8276-7e1f8d0cfe89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:11.523423 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dc7de893-247f-4c22-8276-7e1f8d0cfe89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.523873 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dc7de893-247f-4c22-8276-7e1f8d0cfe89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.524637 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dc7de893-247f-4c22-8276-7e1f8d0cfe89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:11.526254 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dc7de893-247f-4c22-8276-7e1f8d0cfe89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:11.611770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dc7de893-247f-4c22-8276-7e1f8d0cfe89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102237 Jul 04 09:21:11.612549 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 118/256] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 4 09:21:11 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:12.106376 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0638cf18-2694-4593-8a70-9c1257fc74bb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:12.107254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0638cf18-2694-4593-8a70-9c1257fc74bb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:12.114306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0638cf18-2694-4593-8a70-9c1257fc74bb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:12.114306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0638cf18-2694-4593-8a70-9c1257fc74bb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:12.115243 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0638cf18-2694-4593-8a70-9c1257fc74bb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:12.115856 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0638cf18-2694-4593-8a70-9c1257fc74bb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:12.132759 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:12.153407 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-978fd62d-a04f-4818-a248-b71e7bf8fa1c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:12.158583 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-978fd62d-a04f-4818-a248-b71e7bf8fa1c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:12.168543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-978fd62d-a04f-4818-a248-b71e7bf8fa1c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:12.170104 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-978fd62d-a04f-4818-a248-b71e7bf8fa1c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:12.173073 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-978fd62d-a04f-4818-a248-b71e7bf8fa1c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:12.173701 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-978fd62d-a04f-4818-a248-b71e7bf8fa1c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:12.451601 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0638cf18-2694-4593-8a70-9c1257fc74bb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:12.458349 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-978fd62d-a04f-4818-a248-b71e7bf8fa1c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:12.459440 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0638cf18-2694-4593-8a70-9c1257fc74bb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.358037 Jul 04 09:21:12.460095 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 139/257] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:12 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:12.461061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:12.465192 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-92d9f36f-d5c8-4eb5-bd18-12a45fb2386b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:12.465958 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-92d9f36f-d5c8-4eb5-bd18-12a45fb2386b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:12.474966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-978fd62d-a04f-4818-a248-b71e7bf8fa1c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:12.476697 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-92d9f36f-d5c8-4eb5-bd18-12a45fb2386b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:12.476877 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-978fd62d-a04f-4818-a248-b71e7bf8fa1c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:12.478028 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-92d9f36f-d5c8-4eb5-bd18-12a45fb2386b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:12.478222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-978fd62d-a04f-4818-a248-b71e7bf8fa1c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.330361 Jul 04 09:21:12.478848 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 119/258] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:12 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:12.478964 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-92d9f36f-d5c8-4eb5-bd18-12a45fb2386b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:12.479306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-92d9f36f-d5c8-4eb5-bd18-12a45fb2386b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:12.483892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-40384cd0-3523-48ae-995d-2e37c26f0716 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:12.484808 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-40384cd0-3523-48ae-995d-2e37c26f0716 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:12.492210 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40384cd0-3523-48ae-995d-2e37c26f0716 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:12.492801 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40384cd0-3523-48ae-995d-2e37c26f0716 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:12.494782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40384cd0-3523-48ae-995d-2e37c26f0716 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:12.495457 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40384cd0-3523-48ae-995d-2e37c26f0716 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:12.776459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-92d9f36f-d5c8-4eb5-bd18-12a45fb2386b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:12.787434 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-92d9f36f-d5c8-4eb5-bd18-12a45fb2386b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.326075 Jul 04 09:21:12.797814 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 140/259] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:12 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:12.798302 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-40384cd0-3523-48ae-995d-2e37c26f0716 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:12.800426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-40384cd0-3523-48ae-995d-2e37c26f0716 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1313 microversion: 2.1 time: 0.320011 Jul 04 09:21:12.805523 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 120/260] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:12 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:12.937651 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-32f1a582-3187-47a4-8d28-0f6bc4ca0d68 req-256ea1c5-05a3-428f-bbc3-76d2d0d77b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e", "tag": "4342135f-47ac-4111-90c5-e5c2887b2f02"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:12.947438 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-32f1a582-3187-47a4-8d28-0f6bc4ca0d68 req-256ea1c5-05a3-428f-bbc3-76d2d0d77b62 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:12.948138 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-32f1a582-3187-47a4-8d28-0f6bc4ca0d68 req-256ea1c5-05a3-428f-bbc3-76d2d0d77b62 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:12.961742 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-32f1a582-3187-47a4-8d28-0f6bc4ca0d68 req-256ea1c5-05a3-428f-bbc3-76d2d0d77b62 service nova] Creating event network-changed:4342135f-47ac-4111-90c5-e5c2887b2f02 for instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e on hv-cinder-84456 Jul 04 09:21:12.968719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-32f1a582-3187-47a4-8d28-0f6bc4ca0d68 req-256ea1c5-05a3-428f-bbc3-76d2d0d77b62 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038667 Jul 04 09:21:12.969648 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 141/261] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:13.476864 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8325f29a-88a8-40b7-b825-01f7be97492f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:13.477524 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8325f29a-88a8-40b7-b825-01f7be97492f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:13.485242 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8325f29a-88a8-40b7-b825-01f7be97492f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.485720 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8325f29a-88a8-40b7-b825-01f7be97492f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.486477 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8325f29a-88a8-40b7-b825-01f7be97492f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.486908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8325f29a-88a8-40b7-b825-01f7be97492f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.498912 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1d9e8e36-6aa2-459a-98d2-a0d823216349 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:13.499753 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1d9e8e36-6aa2-459a-98d2-a0d823216349 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:13.506743 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1d9e8e36-6aa2-459a-98d2-a0d823216349 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.507624 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1d9e8e36-6aa2-459a-98d2-a0d823216349 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.507965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1d9e8e36-6aa2-459a-98d2-a0d823216349 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.508407 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1d9e8e36-6aa2-459a-98d2-a0d823216349 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.666822 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=4 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:13.687300 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=14 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:13.693299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8325f29a-88a8-40b7-b825-01f7be97492f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:13.701521 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1d9e8e36-6aa2-459a-98d2-a0d823216349 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:13.701804 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8325f29a-88a8-40b7-b825-01f7be97492f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.228746 Jul 04 09:21:13.702573 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 121/262] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:13 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:13.710401 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1d9e8e36-6aa2-459a-98d2-a0d823216349 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:13.712075 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1d9e8e36-6aa2-459a-98d2-a0d823216349 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:13.713801 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1d9e8e36-6aa2-459a-98d2-a0d823216349 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.219986 Jul 04 09:21:13.717086 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 142/263] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:13 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:13.805859 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-aa60b648-0629-46f9-a3c6-c5d06683b502 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:13.807381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-aa60b648-0629-46f9-a3c6-c5d06683b502 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:13.815776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa60b648-0629-46f9-a3c6-c5d06683b502 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.816237 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa60b648-0629-46f9-a3c6-c5d06683b502 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.817022 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa60b648-0629-46f9-a3c6-c5d06683b502 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.817513 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aa60b648-0629-46f9-a3c6-c5d06683b502 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.817656 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-14fa43b3-c865-4a8a-9794-4a00df063d0b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:13.818246 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-14fa43b3-c865-4a8a-9794-4a00df063d0b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:13.824940 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14fa43b3-c865-4a8a-9794-4a00df063d0b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.825445 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14fa43b3-c865-4a8a-9794-4a00df063d0b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.826227 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14fa43b3-c865-4a8a-9794-4a00df063d0b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:13.826668 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14fa43b3-c865-4a8a-9794-4a00df063d0b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:13.980748 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:14.019531 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-14fa43b3-c865-4a8a-9794-4a00df063d0b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:14.027987 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-aa60b648-0629-46f9-a3c6-c5d06683b502 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:14.028286 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-14fa43b3-c865-4a8a-9794-4a00df063d0b tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1313 microversion: 2.1 time: 0.214198 Jul 04 09:21:14.029104 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 143/264] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:13 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:14.040107 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-aa60b648-0629-46f9-a3c6-c5d06683b502 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.238160 Jul 04 09:21:14.041871 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 122/265] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:13 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:14.723689 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8e40120d-c7be-45f1-9486-1f16e998153c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:14.724287 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8e40120d-c7be-45f1-9486-1f16e998153c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:14.731174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e40120d-c7be-45f1-9486-1f16e998153c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:14.731629 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e40120d-c7be-45f1-9486-1f16e998153c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:14.732234 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2cfd90ea-25f3-4fba-bcb8-bebd9e11095d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:14.732635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e40120d-c7be-45f1-9486-1f16e998153c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:14.732825 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e40120d-c7be-45f1-9486-1f16e998153c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:14.732934 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2cfd90ea-25f3-4fba-bcb8-bebd9e11095d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:14.739420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2cfd90ea-25f3-4fba-bcb8-bebd9e11095d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:14.739886 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2cfd90ea-25f3-4fba-bcb8-bebd9e11095d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:14.740655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2cfd90ea-25f3-4fba-bcb8-bebd9e11095d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:14.741123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2cfd90ea-25f3-4fba-bcb8-bebd9e11095d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:15.101086 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8e40120d-c7be-45f1-9486-1f16e998153c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:15.104772 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2cfd90ea-25f3-4fba-bcb8-bebd9e11095d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:15.109475 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8e40120d-c7be-45f1-9486-1f16e998153c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.389674 Jul 04 09:21:15.110142 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 144/266] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:14 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:15.112912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2cfd90ea-25f3-4fba-bcb8-bebd9e11095d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:15.114526 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e2bcc27e-3e34-4a50-8785-80fe44b278d9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:15.114659 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2cfd90ea-25f3-4fba-bcb8-bebd9e11095d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:15.115128 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e2bcc27e-3e34-4a50-8785-80fe44b278d9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:15.115865 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2cfd90ea-25f3-4fba-bcb8-bebd9e11095d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.387934 Jul 04 09:21:15.116601 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 123/267] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:14 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:15.121762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e2bcc27e-3e34-4a50-8785-80fe44b278d9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:15.122208 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e2bcc27e-3e34-4a50-8785-80fe44b278d9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:15.122979 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e2bcc27e-3e34-4a50-8785-80fe44b278d9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:15.123418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e2bcc27e-3e34-4a50-8785-80fe44b278d9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:15.126947 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0b43d232-15f4-4b01-901d-64c88c385c7c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:15.127607 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0b43d232-15f4-4b01-901d-64c88c385c7c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:15.134163 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b43d232-15f4-4b01-901d-64c88c385c7c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:15.134820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b43d232-15f4-4b01-901d-64c88c385c7c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:15.135612 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b43d232-15f4-4b01-901d-64c88c385c7c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:15.136051 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b43d232-15f4-4b01-901d-64c88c385c7c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:15.322602 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e2bcc27e-3e34-4a50-8785-80fe44b278d9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:15.326604 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0b43d232-15f4-4b01-901d-64c88c385c7c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:15.331022 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e2bcc27e-3e34-4a50-8785-80fe44b278d9 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1313 microversion: 2.1 time: 0.219908 Jul 04 09:21:15.331601 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 145/268] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:15 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:15.334684 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0b43d232-15f4-4b01-901d-64c88c385c7c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.217019 Jul 04 09:21:15.335242 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 124/269] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:15 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:16.130703 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fc5a1032-80b4-4b53-bbaa-c09a87d38cfc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:16.131324 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fc5a1032-80b4-4b53-bbaa-c09a87d38cfc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:16.135545 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1f6b0b1d-886e-4fc7-9d80-9e526da57719 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:16.136154 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1f6b0b1d-886e-4fc7-9d80-9e526da57719 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:16.138822 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc5a1032-80b4-4b53-bbaa-c09a87d38cfc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:16.139281 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc5a1032-80b4-4b53-bbaa-c09a87d38cfc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:16.140059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc5a1032-80b4-4b53-bbaa-c09a87d38cfc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:16.140500 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc5a1032-80b4-4b53-bbaa-c09a87d38cfc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:16.142344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1f6b0b1d-886e-4fc7-9d80-9e526da57719 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:16.142805 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1f6b0b1d-886e-4fc7-9d80-9e526da57719 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:16.143569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1f6b0b1d-886e-4fc7-9d80-9e526da57719 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:16.144009 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1f6b0b1d-886e-4fc7-9d80-9e526da57719 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:16.345719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fc5a1032-80b4-4b53-bbaa-c09a87d38cfc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:16.348267 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1f6b0b1d-886e-4fc7-9d80-9e526da57719 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:16.353743 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fc5a1032-80b4-4b53-bbaa-c09a87d38cfc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.226576 Jul 04 09:21:16.354322 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 146/270] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:16 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:16.356643 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1f6b0b1d-886e-4fc7-9d80-9e526da57719 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:16.358258 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1f6b0b1d-886e-4fc7-9d80-9e526da57719 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:16.359203 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-995e5e53-b7bf-4afd-b741-f39d0eacc544 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:16.359437 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1f6b0b1d-886e-4fc7-9d80-9e526da57719 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.228393 Jul 04 09:21:16.359800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-995e5e53-b7bf-4afd-b741-f39d0eacc544 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:16.366862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 125/271] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:16 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:16.366862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ab1fbe06-4261-4162-85a4-24ef32118ecb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:16.366862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ab1fbe06-4261-4162-85a4-24ef32118ecb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:16.367168 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-995e5e53-b7bf-4afd-b741-f39d0eacc544 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:16.367168 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-995e5e53-b7bf-4afd-b741-f39d0eacc544 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:16.367168 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-995e5e53-b7bf-4afd-b741-f39d0eacc544 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:16.367458 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-995e5e53-b7bf-4afd-b741-f39d0eacc544 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:16.372055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab1fbe06-4261-4162-85a4-24ef32118ecb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:16.372517 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab1fbe06-4261-4162-85a4-24ef32118ecb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:16.373330 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab1fbe06-4261-4162-85a4-24ef32118ecb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:16.373775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab1fbe06-4261-4162-85a4-24ef32118ecb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:16.570530 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-995e5e53-b7bf-4afd-b741-f39d0eacc544 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:16.575937 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ab1fbe06-4261-4162-85a4-24ef32118ecb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:16.578621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-995e5e53-b7bf-4afd-b741-f39d0eacc544 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1313 microversion: 2.1 time: 0.223224 Jul 04 09:21:16.579522 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 147/272] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:16 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:16.586423 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ab1fbe06-4261-4162-85a4-24ef32118ecb tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.225002 Jul 04 09:21:16.586956 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 126/273] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:16 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:17.370412 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e9b234ad-e103-4569-ae2e-a189aa1139bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:17.371973 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e9b234ad-e103-4569-ae2e-a189aa1139bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:17.377300 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fd1ef965-f1d4-4f55-b98f-63304490a1a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:17.377920 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fd1ef965-f1d4-4f55-b98f-63304490a1a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:17.378704 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e9b234ad-e103-4569-ae2e-a189aa1139bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.379156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e9b234ad-e103-4569-ae2e-a189aa1139bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.380052 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e9b234ad-e103-4569-ae2e-a189aa1139bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.380498 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e9b234ad-e103-4569-ae2e-a189aa1139bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.385095 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd1ef965-f1d4-4f55-b98f-63304490a1a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.385462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd1ef965-f1d4-4f55-b98f-63304490a1a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.386512 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd1ef965-f1d4-4f55-b98f-63304490a1a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.386964 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd1ef965-f1d4-4f55-b98f-63304490a1a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.588614 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e9b234ad-e103-4569-ae2e-a189aa1139bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:17.597234 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e9b234ad-e103-4569-ae2e-a189aa1139bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.230719 Jul 04 09:21:17.598012 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 148/274] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:17 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:17.600189 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fd1ef965-f1d4-4f55-b98f-63304490a1a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:17.603714 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-374553c3-5a37-4baf-98da-8cd12513f184 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:17.604212 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-374553c3-5a37-4baf-98da-8cd12513f184 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:17.608535 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fd1ef965-f1d4-4f55-b98f-63304490a1a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:17.610182 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fd1ef965-f1d4-4f55-b98f-63304490a1a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:17.610310 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-374553c3-5a37-4baf-98da-8cd12513f184 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.610632 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-374553c3-5a37-4baf-98da-8cd12513f184 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.611343 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fd1ef965-f1d4-4f55-b98f-63304490a1a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.237997 Jul 04 09:21:17.611458 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-374553c3-5a37-4baf-98da-8cd12513f184 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.611810 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-374553c3-5a37-4baf-98da-8cd12513f184 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.611911 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 127/275] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:17 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:17.616452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6405ef81-b309-4426-b70a-fbf9fe5911ee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:17.617678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6405ef81-b309-4426-b70a-fbf9fe5911ee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:17.623449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6405ef81-b309-4426-b70a-fbf9fe5911ee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.623904 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6405ef81-b309-4426-b70a-fbf9fe5911ee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.624706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6405ef81-b309-4426-b70a-fbf9fe5911ee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:17.625174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6405ef81-b309-4426-b70a-fbf9fe5911ee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:17.809936 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-374553c3-5a37-4baf-98da-8cd12513f184 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:17.814049 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6405ef81-b309-4426-b70a-fbf9fe5911ee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:17.817456 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-374553c3-5a37-4baf-98da-8cd12513f184 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1497 microversion: 2.1 time: 0.218439 Jul 04 09:21:17.818023 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 149/276] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:17 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:17.822653 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6405ef81-b309-4426-b70a-fbf9fe5911ee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.209167 Jul 04 09:21:17.823200 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 128/277] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:17 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:18.613993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2a466943-eba3-4cfe-a83b-48c73a271eaa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:18.614545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2a466943-eba3-4cfe-a83b-48c73a271eaa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:18.621344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a466943-eba3-4cfe-a83b-48c73a271eaa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:18.621801 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a466943-eba3-4cfe-a83b-48c73a271eaa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:18.622605 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a466943-eba3-4cfe-a83b-48c73a271eaa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:18.623047 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a466943-eba3-4cfe-a83b-48c73a271eaa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:18.629884 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5cb94b69-bbdf-4068-9591-9b4c1827d1ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:18.630493 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5cb94b69-bbdf-4068-9591-9b4c1827d1ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:18.637183 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5cb94b69-bbdf-4068-9591-9b4c1827d1ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:18.637642 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5cb94b69-bbdf-4068-9591-9b4c1827d1ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:18.638411 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5cb94b69-bbdf-4068-9591-9b4c1827d1ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:18.638851 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5cb94b69-bbdf-4068-9591-9b4c1827d1ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:18.824863 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2a466943-eba3-4cfe-a83b-48c73a271eaa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:18.828394 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5cb94b69-bbdf-4068-9591-9b4c1827d1ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:18.832732 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2a466943-eba3-4cfe-a83b-48c73a271eaa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.222668 Jul 04 09:21:18.833411 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 150/278] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:18 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:18.836877 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5cb94b69-bbdf-4068-9591-9b4c1827d1ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:18.839010 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5cb94b69-bbdf-4068-9591-9b4c1827d1ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:18.840462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5cb94b69-bbdf-4068-9591-9b4c1827d1ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.214408 Jul 04 09:21:18.841184 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 129/279] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:18 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:18.842408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7a1c4ac1-774e-441c-95af-951637f52968 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:18.843018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7a1c4ac1-774e-441c-95af-951637f52968 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:18.848972 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a1c4ac1-774e-441c-95af-951637f52968 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:18.849451 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a1c4ac1-774e-441c-95af-951637f52968 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:18.850204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a1c4ac1-774e-441c-95af-951637f52968 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:18.850635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a1c4ac1-774e-441c-95af-951637f52968 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:18.978660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7a1c4ac1-774e-441c-95af-951637f52968 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:18.986810 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7a1c4ac1-774e-441c-95af-951637f52968 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.149765 Jul 04 09:21:18.987369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 151/280] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:18 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:19.850613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c7ca1cbf-c147-4363-b132-1d796f43643e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:19.851218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c7ca1cbf-c147-4363-b132-1d796f43643e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:19.858670 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7ca1cbf-c147-4363-b132-1d796f43643e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:19.859125 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7ca1cbf-c147-4363-b132-1d796f43643e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:19.860202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7ca1cbf-c147-4363-b132-1d796f43643e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:19.860643 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7ca1cbf-c147-4363-b132-1d796f43643e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:19.860758 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d4f74c82-f1b7-452f-a2bb-5c49c053678f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:19.861864 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d4f74c82-f1b7-452f-a2bb-5c49c053678f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:19.868128 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d4f74c82-f1b7-452f-a2bb-5c49c053678f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:19.868614 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d4f74c82-f1b7-452f-a2bb-5c49c053678f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:19.869571 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d4f74c82-f1b7-452f-a2bb-5c49c053678f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:19.870016 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d4f74c82-f1b7-452f-a2bb-5c49c053678f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:20.057227 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c7ca1cbf-c147-4363-b132-1d796f43643e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:20.064468 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d4f74c82-f1b7-452f-a2bb-5c49c053678f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:20.064669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c7ca1cbf-c147-4363-b132-1d796f43643e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.217902 Jul 04 09:21:20.065270 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 130/281] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:19 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:20.069693 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-edf1c09c-e5ad-413d-ae55-f6c90a0d7cfc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:20.070339 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-edf1c09c-e5ad-413d-ae55-f6c90a0d7cfc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:20.073450 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d4f74c82-f1b7-452f-a2bb-5c49c053678f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:20.074980 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d4f74c82-f1b7-452f-a2bb-5c49c053678f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:20.076051 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edf1c09c-e5ad-413d-ae55-f6c90a0d7cfc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:20.076746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d4f74c82-f1b7-452f-a2bb-5c49c053678f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.219976 Jul 04 09:21:20.076843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edf1c09c-e5ad-413d-ae55-f6c90a0d7cfc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:20.076935 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 152/282] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:19 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:20.077295 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edf1c09c-e5ad-413d-ae55-f6c90a0d7cfc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:20.077734 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edf1c09c-e5ad-413d-ae55-f6c90a0d7cfc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:20.207553 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-edf1c09c-e5ad-413d-ae55-f6c90a0d7cfc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:20.216406 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-edf1c09c-e5ad-413d-ae55-f6c90a0d7cfc tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.150187 Jul 04 09:21:20.216976 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 131/283] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:20 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:21.080884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c4d33e5f-c83f-4c47-9143-e01a4d620a37 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:21.081531 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c4d33e5f-c83f-4c47-9143-e01a4d620a37 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:21.088082 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c4d33e5f-c83f-4c47-9143-e01a4d620a37 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.088544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c4d33e5f-c83f-4c47-9143-e01a4d620a37 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.089663 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c4d33e5f-c83f-4c47-9143-e01a4d620a37 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.090118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c4d33e5f-c83f-4c47-9143-e01a4d620a37 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.095135 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-13fa8fed-bc5f-49ab-9022-c2b9f4d61bb2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:21.095729 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-13fa8fed-bc5f-49ab-9022-c2b9f4d61bb2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:21.102276 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-13fa8fed-bc5f-49ab-9022-c2b9f4d61bb2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.102728 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-13fa8fed-bc5f-49ab-9022-c2b9f4d61bb2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.104130 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-13fa8fed-bc5f-49ab-9022-c2b9f4d61bb2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.104833 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-13fa8fed-bc5f-49ab-9022-c2b9f4d61bb2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.286968 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c4d33e5f-c83f-4c47-9143-e01a4d620a37 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:21.295519 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c4d33e5f-c83f-4c47-9143-e01a4d620a37 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.218342 Jul 04 09:21:21.295846 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-13fa8fed-bc5f-49ab-9022-c2b9f4d61bb2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:21.304784 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 153/284] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:21 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:21.304784 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1c10620f-0293-4cd0-98f6-806a3b1a8b9e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:21.304784 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1c10620f-0293-4cd0-98f6-806a3b1a8b9e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:21.305417 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-13fa8fed-bc5f-49ab-9022-c2b9f4d61bb2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:21.307896 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-13fa8fed-bc5f-49ab-9022-c2b9f4d61bb2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:21.308576 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c10620f-0293-4cd0-98f6-806a3b1a8b9e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.309028 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c10620f-0293-4cd0-98f6-806a3b1a8b9e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.309382 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-13fa8fed-bc5f-49ab-9022-c2b9f4d61bb2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.218032 Jul 04 09:21:21.309864 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c10620f-0293-4cd0-98f6-806a3b1a8b9e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.310303 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c10620f-0293-4cd0-98f6-806a3b1a8b9e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.310481 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 132/285] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:21 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:21.474663 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1c10620f-0293-4cd0-98f6-806a3b1a8b9e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:21.483989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1c10620f-0293-4cd0-98f6-806a3b1a8b9e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.186564 Jul 04 09:21:21.484787 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 154/286] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:21 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:21.516019 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9f150a81-9a6b-4c22-a98c-20d880ce07e8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:21.516515 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9f150a81-9a6b-4c22-a98c-20d880ce07e8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:21.522597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f150a81-9a6b-4c22-a98c-20d880ce07e8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.523052 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f150a81-9a6b-4c22-a98c-20d880ce07e8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.524010 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f150a81-9a6b-4c22-a98c-20d880ce07e8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.524463 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f150a81-9a6b-4c22-a98c-20d880ce07e8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.551515 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9f150a81-9a6b-4c22-a98c-20d880ce07e8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:21:21.633839 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9f150a81-9a6b-4c22-a98c-20d880ce07e8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "DELETE /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 204 len: 0 microversion: 2.1 time: 0.121336 Jul 04 09:21:21.634533 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 133/287] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:21:21 2022] DELETE /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:21:21.642807 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fa4dea12-8797-4c5e-996c-803c643972c8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:21.643423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fa4dea12-8797-4c5e-996c-803c643972c8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:21.649467 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa4dea12-8797-4c5e-996c-803c643972c8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.650545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa4dea12-8797-4c5e-996c-803c643972c8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.651700 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa4dea12-8797-4c5e-996c-803c643972c8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:21.652204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa4dea12-8797-4c5e-996c-803c643972c8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:21.786805 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fa4dea12-8797-4c5e-996c-803c643972c8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:21.795188 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fa4dea12-8797-4c5e-996c-803c643972c8 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1503 microversion: 2.1 time: 0.156464 Jul 04 09:21:21.795748 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 155/288] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:21 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:22.313022 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1d5ef6e0-6557-474d-a8a7-559b1f00dc6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.313746 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1d5ef6e0-6557-474d-a8a7-559b1f00dc6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:22.320328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d5ef6e0-6557-474d-a8a7-559b1f00dc6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:22.320788 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d5ef6e0-6557-474d-a8a7-559b1f00dc6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:22.321577 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d5ef6e0-6557-474d-a8a7-559b1f00dc6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:22.322209 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d5ef6e0-6557-474d-a8a7-559b1f00dc6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:22.327322 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fdd2bc66-b7ea-4d13-897e-903c7e5cd181 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.327933 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fdd2bc66-b7ea-4d13-897e-903c7e5cd181 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:22.334391 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fdd2bc66-b7ea-4d13-897e-903c7e5cd181 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:22.334844 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fdd2bc66-b7ea-4d13-897e-903c7e5cd181 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:22.335615 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fdd2bc66-b7ea-4d13-897e-903c7e5cd181 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:22.336051 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fdd2bc66-b7ea-4d13-897e-903c7e5cd181 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:22.518502 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1d5ef6e0-6557-474d-a8a7-559b1f00dc6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:22.520819 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:22.525962 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fdd2bc66-b7ea-4d13-897e-903c7e5cd181 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:22.528224 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:22.528373 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1d5ef6e0-6557-474d-a8a7-559b1f00dc6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.219543 Jul 04 09:21:22.529944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 134/289] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:22.533654 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-010f893e-ccea-4c43-af7b-32740d7ac7dd tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.534303 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-010f893e-ccea-4c43-af7b-32740d7ac7dd tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:22.535555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fdd2bc66-b7ea-4d13-897e-903c7e5cd181 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:22.537449 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fdd2bc66-b7ea-4d13-897e-903c7e5cd181 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:22.538944 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fdd2bc66-b7ea-4d13-897e-903c7e5cd181 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1745 microversion: 2.20 time: 0.215466 Jul 04 09:21:22.539501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 156/290] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1745 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:22.541354 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-010f893e-ccea-4c43-af7b-32740d7ac7dd tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:22.541810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-010f893e-ccea-4c43-af7b-32740d7ac7dd tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:22.542586 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-010f893e-ccea-4c43-af7b-32740d7ac7dd tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:22.543029 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-010f893e-ccea-4c43-af7b-32740d7ac7dd tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:22.676959 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-010f893e-ccea-4c43-af7b-32740d7ac7dd tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:22.685096 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-010f893e-ccea-4c43-af7b-32740d7ac7dd tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.155009 Jul 04 09:21:22.685667 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 135/291] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:22.812429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0b7a3ff9-c694-4c7c-854e-21f2b3e70475 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:22.813062 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0b7a3ff9-c694-4c7c-854e-21f2b3e70475 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:22.819576 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b7a3ff9-c694-4c7c-854e-21f2b3e70475 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:22.820033 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b7a3ff9-c694-4c7c-854e-21f2b3e70475 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:22.820799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b7a3ff9-c694-4c7c-854e-21f2b3e70475 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:22.821272 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b7a3ff9-c694-4c7c-854e-21f2b3e70475 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:22.951057 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0b7a3ff9-c694-4c7c-854e-21f2b3e70475 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:22.958586 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0b7a3ff9-c694-4c7c-854e-21f2b3e70475 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1503 microversion: 2.1 time: 0.150031 Jul 04 09:21:22.959149 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 157/292] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:22 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:23.545335 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7a4b789c-7eb4-4ad1-bc52-ddac023d8bf3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:23.545954 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7a4b789c-7eb4-4ad1-bc52-ddac023d8bf3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:23.552579 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7a4b789c-7eb4-4ad1-bc52-ddac023d8bf3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:23.553062 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7a4b789c-7eb4-4ad1-bc52-ddac023d8bf3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:23.553847 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7a4b789c-7eb4-4ad1-bc52-ddac023d8bf3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:23.554290 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7a4b789c-7eb4-4ad1-bc52-ddac023d8bf3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:23.557064 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a8348e2e-5819-4b2c-8819-e2ac9964ecc3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:23.557681 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a8348e2e-5819-4b2c-8819-e2ac9964ecc3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:23.564162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a8348e2e-5819-4b2c-8819-e2ac9964ecc3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:23.564616 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a8348e2e-5819-4b2c-8819-e2ac9964ecc3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:23.565417 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a8348e2e-5819-4b2c-8819-e2ac9964ecc3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:23.565855 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a8348e2e-5819-4b2c-8819-e2ac9964ecc3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:23.749296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7a4b789c-7eb4-4ad1-bc52-ddac023d8bf3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:23.752474 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a8348e2e-5819-4b2c-8819-e2ac9964ecc3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:23.756781 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7a4b789c-7eb4-4ad1-bc52-ddac023d8bf3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.215343 Jul 04 09:21:23.757468 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 136/293] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:23 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:23.761330 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a8348e2e-5819-4b2c-8819-e2ac9964ecc3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:23.762865 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a8348e2e-5819-4b2c-8819-e2ac9964ecc3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:23.763563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e3185ae1-f260-443b-9246-9dfbed2aca11 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:23.764029 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a8348e2e-5819-4b2c-8819-e2ac9964ecc3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1745 microversion: 2.20 time: 0.210950 Jul 04 09:21:23.764320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e3185ae1-f260-443b-9246-9dfbed2aca11 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:23.764739 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 158/294] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:23 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1745 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:23.770236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e3185ae1-f260-443b-9246-9dfbed2aca11 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:23.770691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e3185ae1-f260-443b-9246-9dfbed2aca11 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:23.771454 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e3185ae1-f260-443b-9246-9dfbed2aca11 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:23.771894 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e3185ae1-f260-443b-9246-9dfbed2aca11 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:23.903665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e3185ae1-f260-443b-9246-9dfbed2aca11 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:23.911616 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e3185ae1-f260-443b-9246-9dfbed2aca11 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.152498 Jul 04 09:21:23.912125 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 137/295] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:23 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:23.975067 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-905b8165-e4d9-4831-81cb-54544e586d43 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:23.975678 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-905b8165-e4d9-4831-81cb-54544e586d43 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:23.982034 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-905b8165-e4d9-4831-81cb-54544e586d43 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:23.982490 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-905b8165-e4d9-4831-81cb-54544e586d43 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:23.983248 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-905b8165-e4d9-4831-81cb-54544e586d43 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:23.983685 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-905b8165-e4d9-4831-81cb-54544e586d43 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:24.118578 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-905b8165-e4d9-4831-81cb-54544e586d43 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:24.126228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-905b8165-e4d9-4831-81cb-54544e586d43 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1503 microversion: 2.1 time: 0.155065 Jul 04 09:21:24.126869 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 159/296] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:23 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:24.774030 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-880bf033-6be9-44f8-8e6d-de66b72d2dcf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:24.774637 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-880bf033-6be9-44f8-8e6d-de66b72d2dcf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:24.781684 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-880bf033-6be9-44f8-8e6d-de66b72d2dcf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:24.782140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-880bf033-6be9-44f8-8e6d-de66b72d2dcf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:24.782244 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff9d69bb-7f35-4c14-ad6d-2bb004f6dd2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:24.782753 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff9d69bb-7f35-4c14-ad6d-2bb004f6dd2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:24.782908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-880bf033-6be9-44f8-8e6d-de66b72d2dcf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:24.783347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-880bf033-6be9-44f8-8e6d-de66b72d2dcf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:24.789275 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff9d69bb-7f35-4c14-ad6d-2bb004f6dd2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:24.789729 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff9d69bb-7f35-4c14-ad6d-2bb004f6dd2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:24.791147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff9d69bb-7f35-4c14-ad6d-2bb004f6dd2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:24.791607 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff9d69bb-7f35-4c14-ad6d-2bb004f6dd2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:24.975996 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-880bf033-6be9-44f8-8e6d-de66b72d2dcf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:24.983520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff9d69bb-7f35-4c14-ad6d-2bb004f6dd2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:24.984212 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-880bf033-6be9-44f8-8e6d-de66b72d2dcf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.213952 Jul 04 09:21:24.985173 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 138/297] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:24 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:24.989613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-284fe84f-9250-46b6-ba73-0372a8b67647 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:24.990220 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-284fe84f-9250-46b6-ba73-0372a8b67647 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:24.991814 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff9d69bb-7f35-4c14-ad6d-2bb004f6dd2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:24.993356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff9d69bb-7f35-4c14-ad6d-2bb004f6dd2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:24.995397 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff9d69bb-7f35-4c14-ad6d-2bb004f6dd2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1745 microversion: 2.20 time: 0.217113 Jul 04 09:21:24.995990 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 160/298] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:24 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:24.997184 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-284fe84f-9250-46b6-ba73-0372a8b67647 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:24.997644 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-284fe84f-9250-46b6-ba73-0372a8b67647 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:24.998413 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-284fe84f-9250-46b6-ba73-0372a8b67647 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:24.998852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-284fe84f-9250-46b6-ba73-0372a8b67647 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:25.126960 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-284fe84f-9250-46b6-ba73-0372a8b67647 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:25.135451 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-284fe84f-9250-46b6-ba73-0372a8b67647 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.149311 Jul 04 09:21:25.136018 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 139/299] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:24 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:25.143844 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8bb6a7f3-a2c8-4059-a845-2106fa8a7388 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:25.144647 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8bb6a7f3-a2c8-4059-a845-2106fa8a7388 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:25.150914 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8bb6a7f3-a2c8-4059-a845-2106fa8a7388 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:25.151369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8bb6a7f3-a2c8-4059-a845-2106fa8a7388 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:25.152136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8bb6a7f3-a2c8-4059-a845-2106fa8a7388 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:25.152576 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8bb6a7f3-a2c8-4059-a845-2106fa8a7388 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:25.290094 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8bb6a7f3-a2c8-4059-a845-2106fa8a7388 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:25.297886 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8bb6a7f3-a2c8-4059-a845-2106fa8a7388 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1503 microversion: 2.1 time: 0.157957 Jul 04 09:21:25.298447 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 161/300] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:25 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:26.001375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3e220813-f10b-468c-b634-cd6fc40f691d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:26.002010 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3e220813-f10b-468c-b634-cd6fc40f691d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:26.009479 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e220813-f10b-468c-b634-cd6fc40f691d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.010094 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e220813-f10b-468c-b634-cd6fc40f691d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.010874 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e220813-f10b-468c-b634-cd6fc40f691d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.011978 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e220813-f10b-468c-b634-cd6fc40f691d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.015036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4daa669a-1d1c-4e16-b22d-e20fb8bba437 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:26.017815 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4daa669a-1d1c-4e16-b22d-e20fb8bba437 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:26.028238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4daa669a-1d1c-4e16-b22d-e20fb8bba437 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.029510 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4daa669a-1d1c-4e16-b22d-e20fb8bba437 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.030580 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4daa669a-1d1c-4e16-b22d-e20fb8bba437 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.031285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4daa669a-1d1c-4e16-b22d-e20fb8bba437 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.238804 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4daa669a-1d1c-4e16-b22d-e20fb8bba437 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:26.241488 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3e220813-f10b-468c-b634-cd6fc40f691d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:26.247646 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4daa669a-1d1c-4e16-b22d-e20fb8bba437 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:26.249480 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4daa669a-1d1c-4e16-b22d-e20fb8bba437 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:26.250764 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3e220813-f10b-468c-b634-cd6fc40f691d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.253402 Jul 04 09:21:26.250918 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4daa669a-1d1c-4e16-b22d-e20fb8bba437 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1745 microversion: 2.20 time: 0.241109 Jul 04 09:21:26.251354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 162/301] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:26 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:26.251725 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 140/302] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:25 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:26.257058 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-50b7f8ff-e668-41d5-8ef0-7d8d58c2b9ea req-362fb69c-2955-4aba-a120-2c678967ac7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349ad723-ae6f-40a6-b6db-5235354bf944", "name": "network-vif-deleted", "tag": "c5821c99-df05-4919-b01e-057f4fd3b47a"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:26.265473 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7324f9fc-18af-4f88-99c4-b5dd2079a0ef tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:26.266400 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7324f9fc-18af-4f88-99c4-b5dd2079a0ef tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:26.270039 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-50b7f8ff-e668-41d5-8ef0-7d8d58c2b9ea req-362fb69c-2955-4aba-a120-2c678967ac7a service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.270497 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-50b7f8ff-e668-41d5-8ef0-7d8d58c2b9ea req-362fb69c-2955-4aba-a120-2c678967ac7a service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.272615 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7324f9fc-18af-4f88-99c4-b5dd2079a0ef tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.273127 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7324f9fc-18af-4f88-99c4-b5dd2079a0ef tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.273884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7324f9fc-18af-4f88-99c4-b5dd2079a0ef tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.274316 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7324f9fc-18af-4f88-99c4-b5dd2079a0ef tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.288624 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-50b7f8ff-e668-41d5-8ef0-7d8d58c2b9ea req-362fb69c-2955-4aba-a120-2c678967ac7a service nova] Creating event network-vif-deleted:c5821c99-df05-4919-b01e-057f4fd3b47a for instance 349ad723-ae6f-40a6-b6db-5235354bf944 on hv-cinder-84456 Jul 04 09:21:26.293954 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-50b7f8ff-e668-41d5-8ef0-7d8d58c2b9ea req-362fb69c-2955-4aba-a120-2c678967ac7a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040536 Jul 04 09:21:26.294892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 141/303] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:26.318632 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:26.319482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:26.329305 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.329756 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.330531 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.330965 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.364603 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:26.365081 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:26.365546 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lazy-loading 'fault' on Instance uuid 349ad723-ae6f-40a6-b6db-5235354bf944 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:21:26.420348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44e20abe50c041c0b52d788b1cb237fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ecddd48b9a466880e0288edd65ce0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:26.428633 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-40e8fb83-4be0-4696-aa4d-a81a77ac1099 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 200 len: 1303 microversion: 2.1 time: 0.116715 Jul 04 09:21:26.429246 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 142/304] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:26 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:26.444418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7324f9fc-18af-4f88-99c4-b5dd2079a0ef tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:26.453389 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7324f9fc-18af-4f88-99c4-b5dd2079a0ef tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1725 microversion: 2.1 time: 0.192118 Jul 04 09:21:26.453955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 163/305] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:26 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:27.268785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f958c736-bf70-4c11-8913-c9d188e959e0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:27.269561 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f958c736-bf70-4c11-8913-c9d188e959e0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:27.270920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff3701a6-ddf0-4310-93c6-96610c12d6dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:27.271635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff3701a6-ddf0-4310-93c6-96610c12d6dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:27.277343 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f958c736-bf70-4c11-8913-c9d188e959e0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.278036 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f958c736-bf70-4c11-8913-c9d188e959e0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.278829 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f958c736-bf70-4c11-8913-c9d188e959e0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.279307 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f958c736-bf70-4c11-8913-c9d188e959e0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.280036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff3701a6-ddf0-4310-93c6-96610c12d6dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.280494 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff3701a6-ddf0-4310-93c6-96610c12d6dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.281308 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff3701a6-ddf0-4310-93c6-96610c12d6dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.281745 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff3701a6-ddf0-4310-93c6-96610c12d6dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.482357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff3701a6-ddf0-4310-93c6-96610c12d6dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:27.487109 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f958c736-bf70-4c11-8913-c9d188e959e0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:27.490385 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff3701a6-ddf0-4310-93c6-96610c12d6dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:27.491887 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff3701a6-ddf0-4310-93c6-96610c12d6dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:27.493056 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff3701a6-ddf0-4310-93c6-96610c12d6dd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1745 microversion: 2.20 time: 0.226376 Jul 04 09:21:27.493614 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 164/306] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:27 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1745 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:27.494944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f958c736-bf70-4c11-8913-c9d188e959e0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.230802 Jul 04 09:21:27.495675 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 143/307] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:27 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:27.498007 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-6f409862-62b2-4a51-8d0c-e31a8c77e399 req-ae74e17d-1f18-4379-b10f-c47d751a8af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8dcc08-23ef-46ee-b941-55a7f1716d41", "name": "network-vif-plugged", "status": "completed", "tag": "170feb05-63b9-496e-b589-498558ed153c"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:27.501373 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3f6d8896-5b3f-46a1-b109-d3649a524ae7 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:27.502245 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3f6d8896-5b3f-46a1-b109-d3649a524ae7 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] [instance: 349ad723-ae6f-40a6-b6db-5235354bf944] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:27.505997 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-6f409862-62b2-4a51-8d0c-e31a8c77e399 req-ae74e17d-1f18-4379-b10f-c47d751a8af6 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.506437 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-6f409862-62b2-4a51-8d0c-e31a8c77e399 req-ae74e17d-1f18-4379-b10f-c47d751a8af6 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.509004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3f6d8896-5b3f-46a1-b109-d3649a524ae7 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.509563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3f6d8896-5b3f-46a1-b109-d3649a524ae7 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.510412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3f6d8896-5b3f-46a1-b109-d3649a524ae7 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.510897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3f6d8896-5b3f-46a1-b109-d3649a524ae7 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.517304 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-6f409862-62b2-4a51-8d0c-e31a8c77e399 req-ae74e17d-1f18-4379-b10f-c47d751a8af6 service nova] Creating event network-vif-plugged:170feb05-63b9-496e-b589-498558ed153c for instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 on hv-cinder-84456 Jul 04 09:21:27.522228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-6f409862-62b2-4a51-8d0c-e31a8c77e399 req-ae74e17d-1f18-4379-b10f-c47d751a8af6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027539 Jul 04 09:21:27.522803 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 165/308] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:27.525755 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-3f6d8896-5b3f-46a1-b109-d3649a524ae7 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] HTTP exception thrown: Instance 349ad723-ae6f-40a6-b6db-5235354bf944 could not be found. Jul 04 09:21:27.528329 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a23da693-da3d-4e76-a865-8ef5b67cce00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3f6d8896-5b3f-46a1-b109-d3649a524ae7 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Request method failure captured: Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 HTTP/1.1 Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrDpxId8J8AJlvhsG9e-EYUqJqcV1HVSLf7XpYVHjCmD6sMoA-BsMZ94Zl3OLqiy-685KnTjXUN1nQt3qCegIDG2GLprgJYvvBy1fdkU0wYrnaIHUTVbm5U_WIeGvosI8rO78GT2DtgPLNKK2iNPZBJddiggdQl8GmnA6s8pPy0YsUc Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: d6ecddd48b9a466880e0288edd65ce0a Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesActionsTest-648851749 Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:21:27.528838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d6ecddd48b9a466880e0288edd65ce0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d6ecddd48b9a466880e0288edd65ce0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d6ecddd48b9a466880e0288edd65ce0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d6ecddd48b9a466880e0288edd65ce0a", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesActionsTest-648851749 Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: d6ecddd48b9a466880e0288edd65ce0a Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesActionsTest-648851749 Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesActionsTest-648851749-project Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 44e20abe50c041c0b52d788b1cb237fe Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesActionsTest-648851749-project Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 349ad723-ae6f-40a6-b6db-5235354bf944 could not be found. Jul 04 09:21:27.530140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '349ad723-ae6f-40a6-b6db-5235354bf944'} Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349ad723-ae6f-40a6-b6db-5235354bf944 could not be found. Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:21:27.530830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349ad723-ae6f-40a6-b6db-5235354bf944 could not be found. Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349ad723-ae6f-40a6-b6db-5235354bf944 could not be found. Jul 04 09:21:27.532180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:21:27.533595 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a23da693-da3d-4e76-a865-8ef5b67cce00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:27.533687 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3f6d8896-5b3f-46a1-b109-d3649a524ae7 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] Returning 404 to user: Instance 349ad723-ae6f-40a6-b6db-5235354bf944 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:21:27.533687 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3f6d8896-5b3f-46a1-b109-d3649a524ae7 tempest-VolumesActionsTest-648851749 tempest-VolumesActionsTest-648851749-project] 10.222.0.71 "GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944" status: 404 len: 111 microversion: 2.1 time: 0.033454 Jul 04 09:21:27.533687 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 144/309] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:27 2022] GET /compute/v2.1/servers/349ad723-ae6f-40a6-b6db-5235354bf944 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:21:27.540269 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a23da693-da3d-4e76-a865-8ef5b67cce00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.540720 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a23da693-da3d-4e76-a865-8ef5b67cce00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.541523 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a23da693-da3d-4e76-a865-8ef5b67cce00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.541958 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a23da693-da3d-4e76-a865-8ef5b67cce00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.680806 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a23da693-da3d-4e76-a865-8ef5b67cce00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:27.690321 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a23da693-da3d-4e76-a865-8ef5b67cce00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1702 microversion: 2.1 time: 0.166384 Jul 04 09:21:27.698436 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 166/310] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:27 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1702 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:27.706502 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f667470a-caaa-4247-8c74-0534b0fa6269 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:27.712599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f667470a-caaa-4247-8c74-0534b0fa6269 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.713075 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f667470a-caaa-4247-8c74-0534b0fa6269 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.775352 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f667470a-caaa-4247-8c74-0534b0fa6269 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Going to try to start instance {{(pid=117665) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 09:21:27.829423 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f667470a-caaa-4247-8c74-0534b0fa6269 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/action" status: 202 len: 0 microversion: 2.1 time: 0.125712 Jul 04 09:21:27.830225 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 145/311] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:21:27 2022] POST /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:21:27.837883 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c1f3101f-1990-488f-a1a2-4fd3fb43db9a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:27.838509 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c1f3101f-1990-488f-a1a2-4fd3fb43db9a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:27.844888 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1f3101f-1990-488f-a1a2-4fd3fb43db9a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.845393 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1f3101f-1990-488f-a1a2-4fd3fb43db9a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:27.846398 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1f3101f-1990-488f-a1a2-4fd3fb43db9a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:27.846612 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1f3101f-1990-488f-a1a2-4fd3fb43db9a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:28.001855 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c1f3101f-1990-488f-a1a2-4fd3fb43db9a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:28.012101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c1f3101f-1990-488f-a1a2-4fd3fb43db9a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1711 microversion: 2.1 time: 0.177815 Jul 04 09:21:28.013123 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 167/312] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:27 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1711 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:28.512885 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-eb24c305-63c2-4239-afe9-26f6a11b0bf4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:28.513561 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-eb24c305-63c2-4239-afe9-26f6a11b0bf4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:28.514582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e491b77c-e54e-4d9e-93d6-83198ad3d43b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:28.515283 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e491b77c-e54e-4d9e-93d6-83198ad3d43b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:28.519949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eb24c305-63c2-4239-afe9-26f6a11b0bf4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:28.520405 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eb24c305-63c2-4239-afe9-26f6a11b0bf4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:28.521215 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eb24c305-63c2-4239-afe9-26f6a11b0bf4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:28.521730 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e491b77c-e54e-4d9e-93d6-83198ad3d43b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:28.521859 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eb24c305-63c2-4239-afe9-26f6a11b0bf4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:28.522763 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e491b77c-e54e-4d9e-93d6-83198ad3d43b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:28.523536 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e491b77c-e54e-4d9e-93d6-83198ad3d43b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:28.523972 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e491b77c-e54e-4d9e-93d6-83198ad3d43b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:28.719154 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-eb24c305-63c2-4239-afe9-26f6a11b0bf4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:28.726303 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e491b77c-e54e-4d9e-93d6-83198ad3d43b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:28.726982 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-eb24c305-63c2-4239-afe9-26f6a11b0bf4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:28.728506 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-eb24c305-63c2-4239-afe9-26f6a11b0bf4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:28.730064 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-eb24c305-63c2-4239-afe9-26f6a11b0bf4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1745 microversion: 2.20 time: 0.221605 Jul 04 09:21:28.730635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 168/313] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:28 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:28.734934 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e491b77c-e54e-4d9e-93d6-83198ad3d43b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.226855 Jul 04 09:21:28.735569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 146/314] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:28 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:29.031065 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2756913e-9c02-4748-8e7e-9abcbd2d7c1b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:29.031668 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2756913e-9c02-4748-8e7e-9abcbd2d7c1b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:29.037670 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2756913e-9c02-4748-8e7e-9abcbd2d7c1b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:29.038117 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2756913e-9c02-4748-8e7e-9abcbd2d7c1b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:29.038871 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2756913e-9c02-4748-8e7e-9abcbd2d7c1b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:29.039301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2756913e-9c02-4748-8e7e-9abcbd2d7c1b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:29.081652 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-caa55ec3-5077-472e-935d-1ea55d6c0c06 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:29.082157 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-caa55ec3-5077-472e-935d-1ea55d6c0c06 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:29.088168 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-caa55ec3-5077-472e-935d-1ea55d6c0c06 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:29.088630 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-caa55ec3-5077-472e-935d-1ea55d6c0c06 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:29.090191 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-caa55ec3-5077-472e-935d-1ea55d6c0c06 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:29.090642 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-caa55ec3-5077-472e-935d-1ea55d6c0c06 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:29.173965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2756913e-9c02-4748-8e7e-9abcbd2d7c1b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:29.182260 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2756913e-9c02-4748-8e7e-9abcbd2d7c1b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1711 microversion: 2.1 time: 0.155419 Jul 04 09:21:29.183945 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 169/315] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:29 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1711 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:29.231703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-caa55ec3-5077-472e-935d-1ea55d6c0c06 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lazy-loading 'services' on Instance uuid ef800788-96b8-4498-b1ec-3c1d79859356 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:21:29.344457 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-caa55ec3-5077-472e-935d-1ea55d6c0c06 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356/os-volume_attachments/a739683d-8757-42c1-a060-e1811acd68cc" status: 202 len: 0 microversion: 2.1 time: 0.266490 Jul 04 09:21:29.344940 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 147/316] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:21:29 2022] DELETE /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356/os-volume_attachments/a739683d-8757-42c1-a060-e1811acd68cc => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:21:29.749453 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e7a2a733-ab9f-4e45-a8dd-1bf1b1f555b2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:29.750067 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e7a2a733-ab9f-4e45-a8dd-1bf1b1f555b2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:29.753206 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fcfc20f6-a57b-4516-b901-54bd50f25384 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:29.753986 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fcfc20f6-a57b-4516-b901-54bd50f25384 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:29.756574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7a2a733-ab9f-4e45-a8dd-1bf1b1f555b2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:29.757046 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7a2a733-ab9f-4e45-a8dd-1bf1b1f555b2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:29.757844 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7a2a733-ab9f-4e45-a8dd-1bf1b1f555b2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:29.758289 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e7a2a733-ab9f-4e45-a8dd-1bf1b1f555b2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:29.760246 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fcfc20f6-a57b-4516-b901-54bd50f25384 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:29.761924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fcfc20f6-a57b-4516-b901-54bd50f25384 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:29.762495 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fcfc20f6-a57b-4516-b901-54bd50f25384 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:29.762948 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fcfc20f6-a57b-4516-b901-54bd50f25384 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:29.961949 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fcfc20f6-a57b-4516-b901-54bd50f25384 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:29.966717 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e7a2a733-ab9f-4e45-a8dd-1bf1b1f555b2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:29.969871 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fcfc20f6-a57b-4516-b901-54bd50f25384 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.221510 Jul 04 09:21:29.970442 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 148/317] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:29 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:29.975133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e7a2a733-ab9f-4e45-a8dd-1bf1b1f555b2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:29.976714 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e7a2a733-ab9f-4e45-a8dd-1bf1b1f555b2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:29.977891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e7a2a733-ab9f-4e45-a8dd-1bf1b1f555b2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1745 microversion: 2.20 time: 0.233239 Jul 04 09:21:29.978427 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 170/318] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:29 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1745 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:30.200132 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-571ac512-4de2-4071-89ef-4ca17feefaf2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:30.200741 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-571ac512-4de2-4071-89ef-4ca17feefaf2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:30.202736 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:30.207976 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-571ac512-4de2-4071-89ef-4ca17feefaf2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:30.208427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-571ac512-4de2-4071-89ef-4ca17feefaf2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:30.209218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-571ac512-4de2-4071-89ef-4ca17feefaf2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:30.209707 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-571ac512-4de2-4071-89ef-4ca17feefaf2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:30.523763 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-571ac512-4de2-4071-89ef-4ca17feefaf2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:30.532406 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-571ac512-4de2-4071-89ef-4ca17feefaf2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1711 microversion: 2.1 time: 0.336192 Jul 04 09:21:30.532974 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 149/319] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:30 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1711 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:30.985920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7dc8ee04-b352-4364-a864-a4532b1e4550 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:30.986538 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7dc8ee04-b352-4364-a864-a4532b1e4550 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:30.993000 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7dc8ee04-b352-4364-a864-a4532b1e4550 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:30.993488 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7dc8ee04-b352-4364-a864-a4532b1e4550 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:30.994254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7dc8ee04-b352-4364-a864-a4532b1e4550 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:30.994692 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7dc8ee04-b352-4364-a864-a4532b1e4550 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:30.996888 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d021b0c7-bcaf-4d3e-a89e-f602ffb5e5e1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:30.997520 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d021b0c7-bcaf-4d3e-a89e-f602ffb5e5e1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:31.003922 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d021b0c7-bcaf-4d3e-a89e-f602ffb5e5e1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:31.004369 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d021b0c7-bcaf-4d3e-a89e-f602ffb5e5e1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:31.005147 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d021b0c7-bcaf-4d3e-a89e-f602ffb5e5e1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:31.005582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d021b0c7-bcaf-4d3e-a89e-f602ffb5e5e1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:31.193568 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7dc8ee04-b352-4364-a864-a4532b1e4550 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:31.196615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d021b0c7-bcaf-4d3e-a89e-f602ffb5e5e1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:31.199792 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:31.202326 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7dc8ee04-b352-4364-a864-a4532b1e4550 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.220315 Jul 04 09:21:31.202889 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 171/320] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:30 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:31.206935 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d021b0c7-bcaf-4d3e-a89e-f602ffb5e5e1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:31.208449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d021b0c7-bcaf-4d3e-a89e-f602ffb5e5e1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:31.209618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d021b0c7-bcaf-4d3e-a89e-f602ffb5e5e1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1745 microversion: 2.20 time: 0.217999 Jul 04 09:21:31.210162 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 150/321] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:30 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1745 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:31.549394 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-05b2a9b6-6a83-4f35-8c19-ca699128d2a7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:31.550005 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-05b2a9b6-6a83-4f35-8c19-ca699128d2a7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:31.556022 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05b2a9b6-6a83-4f35-8c19-ca699128d2a7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:31.556467 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05b2a9b6-6a83-4f35-8c19-ca699128d2a7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:31.557259 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05b2a9b6-6a83-4f35-8c19-ca699128d2a7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:31.558700 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05b2a9b6-6a83-4f35-8c19-ca699128d2a7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:31.691176 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-05b2a9b6-6a83-4f35-8c19-ca699128d2a7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:31.699398 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-05b2a9b6-6a83-4f35-8c19-ca699128d2a7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1711 microversion: 2.1 time: 0.153808 Jul 04 09:21:31.699949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 172/322] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:31 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:32.220630 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b619a323-01f3-42f1-bb4d-137431358de3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:32.221302 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b619a323-01f3-42f1-bb4d-137431358de3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:32.227614 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2a26407e-8bd1-4fe1-8186-cd990e974cc6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:32.228344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2a26407e-8bd1-4fe1-8186-cd990e974cc6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:32.229276 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b619a323-01f3-42f1-bb4d-137431358de3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:32.229892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b619a323-01f3-42f1-bb4d-137431358de3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:32.230664 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b619a323-01f3-42f1-bb4d-137431358de3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:32.231108 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b619a323-01f3-42f1-bb4d-137431358de3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:32.234901 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a26407e-8bd1-4fe1-8186-cd990e974cc6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:32.235358 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a26407e-8bd1-4fe1-8186-cd990e974cc6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:32.236166 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a26407e-8bd1-4fe1-8186-cd990e974cc6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:32.236610 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a26407e-8bd1-4fe1-8186-cd990e974cc6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:32.420380 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b619a323-01f3-42f1-bb4d-137431358de3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:32.431073 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b619a323-01f3-42f1-bb4d-137431358de3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.215052 Jul 04 09:21:32.432890 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 151/323] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:32 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:32.445623 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2a26407e-8bd1-4fe1-8186-cd990e974cc6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:32.454804 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2a26407e-8bd1-4fe1-8186-cd990e974cc6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:32.456422 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2a26407e-8bd1-4fe1-8186-cd990e974cc6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:32.457633 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2a26407e-8bd1-4fe1-8186-cd990e974cc6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1745 microversion: 2.20 time: 0.234015 Jul 04 09:21:32.458179 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 173/324] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:32 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1745 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:32.715786 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9641c798-64ac-4345-8d1a-dde106c5298e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:32.716393 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9641c798-64ac-4345-8d1a-dde106c5298e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:32.722505 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9641c798-64ac-4345-8d1a-dde106c5298e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:32.722953 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9641c798-64ac-4345-8d1a-dde106c5298e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:32.723710 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9641c798-64ac-4345-8d1a-dde106c5298e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:32.724145 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9641c798-64ac-4345-8d1a-dde106c5298e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:32.850658 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9641c798-64ac-4345-8d1a-dde106c5298e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:32.858838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9641c798-64ac-4345-8d1a-dde106c5298e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1715 microversion: 2.1 time: 0.147223 Jul 04 09:21:32.859407 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 152/325] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:32 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1715 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:33.454828 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cb101d52-afe1-40d9-a966-cd0d4d4ec978 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:33.455449 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cb101d52-afe1-40d9-a966-cd0d4d4ec978 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:33.469768 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb101d52-afe1-40d9-a966-cd0d4d4ec978 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:33.470257 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb101d52-afe1-40d9-a966-cd0d4d4ec978 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:33.471056 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb101d52-afe1-40d9-a966-cd0d4d4ec978 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:33.471492 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb101d52-afe1-40d9-a966-cd0d4d4ec978 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:33.477227 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-15ca6a94-94db-4b7d-9e0a-631105c93b21 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:33.479710 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-15ca6a94-94db-4b7d-9e0a-631105c93b21 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:33.495017 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15ca6a94-94db-4b7d-9e0a-631105c93b21 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:33.496376 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15ca6a94-94db-4b7d-9e0a-631105c93b21 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:33.497557 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15ca6a94-94db-4b7d-9e0a-631105c93b21 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:33.498384 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15ca6a94-94db-4b7d-9e0a-631105c93b21 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:33.531079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:33.719602 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-15ca6a94-94db-4b7d-9e0a-631105c93b21 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:33.735296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-15ca6a94-94db-4b7d-9e0a-631105c93b21 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:33.738376 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-15ca6a94-94db-4b7d-9e0a-631105c93b21 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:33.740060 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-15ca6a94-94db-4b7d-9e0a-631105c93b21 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.266840 Jul 04 09:21:33.740730 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 153/326] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:33 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:33.750718 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-494fdc6c-e2dc-44b4-9b12-2c9d0260a0fc tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:33.752238 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-494fdc6c-e2dc-44b4-9b12-2c9d0260a0fc tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:33.789450 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-494fdc6c-e2dc-44b4-9b12-2c9d0260a0fc tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:33.790833 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cb101d52-afe1-40d9-a966-cd0d4d4ec978 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:33.791545 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-494fdc6c-e2dc-44b4-9b12-2c9d0260a0fc tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:33.796678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-494fdc6c-e2dc-44b4-9b12-2c9d0260a0fc tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:33.800446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-494fdc6c-e2dc-44b4-9b12-2c9d0260a0fc tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:33.820600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cb101d52-afe1-40d9-a966-cd0d4d4ec978 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.370160 Jul 04 09:21:33.824487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 174/327] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:33 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:33.916754 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-494fdc6c-e2dc-44b4-9b12-2c9d0260a0fc tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:21:34.200630 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-494fdc6c-e2dc-44b4-9b12-2c9d0260a0fc tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 204 len: 0 microversion: 2.1 time: 0.456039 Jul 04 09:21:34.201282 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 154/328] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:21:33 2022] DELETE /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:21:34.215837 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3707d9b7-8a5e-443b-a14b-f1946fbd25ff tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:34.216455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3707d9b7-8a5e-443b-a14b-f1946fbd25ff tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:34.228732 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3707d9b7-8a5e-443b-a14b-f1946fbd25ff tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:34.229222 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3707d9b7-8a5e-443b-a14b-f1946fbd25ff tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:34.230010 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3707d9b7-8a5e-443b-a14b-f1946fbd25ff tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:34.231108 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3707d9b7-8a5e-443b-a14b-f1946fbd25ff tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:34.419792 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3707d9b7-8a5e-443b-a14b-f1946fbd25ff tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:34.429186 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3707d9b7-8a5e-443b-a14b-f1946fbd25ff tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1511 microversion: 2.1 time: 0.223179 Jul 04 09:21:34.430310 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 175/329] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:34 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:34.762895 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5dfa8e73-1689-4558-91b4-36a0f5ebb5e9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:34.764840 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5dfa8e73-1689-4558-91b4-36a0f5ebb5e9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:34.772047 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5dfa8e73-1689-4558-91b4-36a0f5ebb5e9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:34.772753 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5dfa8e73-1689-4558-91b4-36a0f5ebb5e9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:34.774471 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5dfa8e73-1689-4558-91b4-36a0f5ebb5e9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:34.775181 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5dfa8e73-1689-4558-91b4-36a0f5ebb5e9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:34.840418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0098b014-b24e-4a62-bff8-a1bb8bf7b906 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:34.842614 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0098b014-b24e-4a62-bff8-a1bb8bf7b906 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:34.849834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0098b014-b24e-4a62-bff8-a1bb8bf7b906 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:34.850537 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0098b014-b24e-4a62-bff8-a1bb8bf7b906 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:34.851778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0098b014-b24e-4a62-bff8-a1bb8bf7b906 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:34.852370 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0098b014-b24e-4a62-bff8-a1bb8bf7b906 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:34.981589 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5dfa8e73-1689-4558-91b4-36a0f5ebb5e9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:34.991253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5dfa8e73-1689-4558-91b4-36a0f5ebb5e9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:34.995239 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5dfa8e73-1689-4558-91b4-36a0f5ebb5e9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:34.997281 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5dfa8e73-1689-4558-91b4-36a0f5ebb5e9 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.240697 Jul 04 09:21:35.008168 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 155/330] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:34 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:35.123289 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0098b014-b24e-4a62-bff8-a1bb8bf7b906 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:35.131801 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0098b014-b24e-4a62-bff8-a1bb8bf7b906 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.295973 Jul 04 09:21:35.137488 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 176/331] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:34 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:35.447479 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9c9e7c69-24a8-415c-a90f-e5ef6a432f32 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:35.448202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9c9e7c69-24a8-415c-a90f-e5ef6a432f32 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:35.458756 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9c9e7c69-24a8-415c-a90f-e5ef6a432f32 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:35.459273 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9c9e7c69-24a8-415c-a90f-e5ef6a432f32 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:35.460327 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9c9e7c69-24a8-415c-a90f-e5ef6a432f32 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:35.463976 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9c9e7c69-24a8-415c-a90f-e5ef6a432f32 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:35.643224 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9c9e7c69-24a8-415c-a90f-e5ef6a432f32 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:35.663716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9c9e7c69-24a8-415c-a90f-e5ef6a432f32 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1511 microversion: 2.1 time: 0.220125 Jul 04 09:21:35.673732 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 156/332] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:35 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:36.022224 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-225c6270-b0a8-427e-96a4-c59bdf0c3046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:36.022973 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-225c6270-b0a8-427e-96a4-c59bdf0c3046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:36.040546 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-225c6270-b0a8-427e-96a4-c59bdf0c3046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:36.041404 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-225c6270-b0a8-427e-96a4-c59bdf0c3046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:36.045464 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-225c6270-b0a8-427e-96a4-c59bdf0c3046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:36.047355 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-225c6270-b0a8-427e-96a4-c59bdf0c3046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:36.155704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4212823a-46a3-4fc9-89b2-b6fed95ef1f9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:36.162065 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4212823a-46a3-4fc9-89b2-b6fed95ef1f9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:36.172364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4212823a-46a3-4fc9-89b2-b6fed95ef1f9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:36.172825 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4212823a-46a3-4fc9-89b2-b6fed95ef1f9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:36.173731 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4212823a-46a3-4fc9-89b2-b6fed95ef1f9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:36.174172 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4212823a-46a3-4fc9-89b2-b6fed95ef1f9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:36.410061 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-225c6270-b0a8-427e-96a4-c59bdf0c3046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:36.424500 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-225c6270-b0a8-427e-96a4-c59bdf0c3046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:36.428050 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-225c6270-b0a8-427e-96a4-c59bdf0c3046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:36.429077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-225c6270-b0a8-427e-96a4-c59bdf0c3046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.411756 Jul 04 09:21:36.457460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 177/333] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:36 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:36.463480 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4212823a-46a3-4fc9-89b2-b6fed95ef1f9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:36.483548 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4212823a-46a3-4fc9-89b2-b6fed95ef1f9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.330514 Jul 04 09:21:36.486407 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 157/334] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:36 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:36.697958 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c7033fcc-c0f2-4129-952d-e54853f148af tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:36.698588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c7033fcc-c0f2-4129-952d-e54853f148af tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:36.706650 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c7033fcc-c0f2-4129-952d-e54853f148af tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:36.707190 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c7033fcc-c0f2-4129-952d-e54853f148af tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:36.708047 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c7033fcc-c0f2-4129-952d-e54853f148af tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:36.708600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c7033fcc-c0f2-4129-952d-e54853f148af tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:36.932949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c7033fcc-c0f2-4129-952d-e54853f148af tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:36.943750 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c7033fcc-c0f2-4129-952d-e54853f148af tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1511 microversion: 2.1 time: 0.256054 Jul 04 09:21:36.957374 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 178/335] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:36 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:37.452804 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d3916b11-13a9-4637-b52a-a2c03538b309 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:37.454156 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d3916b11-13a9-4637-b52a-a2c03538b309 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:37.469631 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3916b11-13a9-4637-b52a-a2c03538b309 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:37.470362 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3916b11-13a9-4637-b52a-a2c03538b309 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:37.471819 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3916b11-13a9-4637-b52a-a2c03538b309 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:37.472709 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3916b11-13a9-4637-b52a-a2c03538b309 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:37.497976 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-8b0b11a8-f387-453a-b2de-22c89d386441 req-f73c7bdb-6fbb-4697-8c06-91b7675bd30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef800788-96b8-4498-b1ec-3c1d79859356", "name": "network-vif-deleted", "tag": "97ddda1e-b3ff-4108-a50f-c183eb0dbf3e"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:37.515541 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:37.542958 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8b0b11a8-f387-453a-b2de-22c89d386441 req-f73c7bdb-6fbb-4697-8c06-91b7675bd30a service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:37.544839 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8b0b11a8-f387-453a-b2de-22c89d386441 req-f73c7bdb-6fbb-4697-8c06-91b7675bd30a service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:37.580432 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-8b0b11a8-f387-453a-b2de-22c89d386441 req-f73c7bdb-6fbb-4697-8c06-91b7675bd30a service nova] Creating event network-vif-deleted:97ddda1e-b3ff-4108-a50f-c183eb0dbf3e for instance ef800788-96b8-4498-b1ec-3c1d79859356 on hv-cinder-84456 Jul 04 09:21:37.586072 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-8b0b11a8-f387-453a-b2de-22c89d386441 req-f73c7bdb-6fbb-4697-8c06-91b7675bd30a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096781 Jul 04 09:21:37.590253 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 179/336] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:37.597409 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7594b2ba-6679-45cc-ab81-34fc66b68d1a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:37.598330 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7594b2ba-6679-45cc-ab81-34fc66b68d1a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:37.605678 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7594b2ba-6679-45cc-ab81-34fc66b68d1a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:37.606399 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7594b2ba-6679-45cc-ab81-34fc66b68d1a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:37.607348 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7594b2ba-6679-45cc-ab81-34fc66b68d1a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:37.607946 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7594b2ba-6679-45cc-ab81-34fc66b68d1a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:37.808709 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d3916b11-13a9-4637-b52a-a2c03538b309 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:37.820523 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d3916b11-13a9-4637-b52a-a2c03538b309 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:37.822523 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d3916b11-13a9-4637-b52a-a2c03538b309 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:37.826119 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d3916b11-13a9-4637-b52a-a2c03538b309 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.381627 Jul 04 09:21:37.830333 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 158/337] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:37 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:37.904432 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7594b2ba-6679-45cc-ab81-34fc66b68d1a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:37.917889 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7594b2ba-6679-45cc-ab81-34fc66b68d1a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.325005 Jul 04 09:21:37.927120 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 180/338] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:37 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:37.975377 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:37.976260 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:37.983934 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:37.984533 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:37.985446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:37.986123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:38.031629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:38.032226 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:38.032743 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lazy-loading 'fault' on Instance uuid ef800788-96b8-4498-b1ec-3c1d79859356 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:21:38.092201 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:38.106909 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a7a01e43-dfee-48b3-80d0-490459ee5d21 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 200 len: 1306 microversion: 2.1 time: 0.134571 Jul 04 09:21:38.107721 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 159/339] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:37 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 1306 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:38.860530 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1a3d1985-68d8-4a93-8414-251e30abc648 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:38.862246 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1a3d1985-68d8-4a93-8414-251e30abc648 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:38.874877 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a3d1985-68d8-4a93-8414-251e30abc648 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:38.875334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a3d1985-68d8-4a93-8414-251e30abc648 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:38.876271 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a3d1985-68d8-4a93-8414-251e30abc648 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:38.876738 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a3d1985-68d8-4a93-8414-251e30abc648 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:38.938355 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8ce4a195-ac3c-4da2-ad05-83c871121623 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:38.939946 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8ce4a195-ac3c-4da2-ad05-83c871121623 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:38.970602 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ce4a195-ac3c-4da2-ad05-83c871121623 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:38.971955 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ce4a195-ac3c-4da2-ad05-83c871121623 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:38.973335 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ce4a195-ac3c-4da2-ad05-83c871121623 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:38.974415 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ce4a195-ac3c-4da2-ad05-83c871121623 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:39.038965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1a3d1985-68d8-4a93-8414-251e30abc648 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:39.051292 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1a3d1985-68d8-4a93-8414-251e30abc648 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:39.055190 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1a3d1985-68d8-4a93-8414-251e30abc648 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:39.056660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1a3d1985-68d8-4a93-8414-251e30abc648 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.202574 Jul 04 09:21:39.064009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 181/340] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:38 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:39.124211 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-85de1208-e947-4186-b281-f8bb5f4ce3fe tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:39.125297 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-85de1208-e947-4186-b281-f8bb5f4ce3fe tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: ef800788-96b8-4498-b1ec-3c1d79859356] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:39.135801 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85de1208-e947-4186-b281-f8bb5f4ce3fe tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:39.137144 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85de1208-e947-4186-b281-f8bb5f4ce3fe tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:39.144391 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85de1208-e947-4186-b281-f8bb5f4ce3fe tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:39.145264 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85de1208-e947-4186-b281-f8bb5f4ce3fe tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:39.167977 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-85de1208-e947-4186-b281-f8bb5f4ce3fe tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] HTTP exception thrown: Instance ef800788-96b8-4498-b1ec-3c1d79859356 could not be found. Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-85de1208-e947-4186-b281-f8bb5f4ce3fe tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Request method failure captured: Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 HTTP/1.1 Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrDbPb1VNFHlx2Yfjr1xe6O8XXvS6upeUODc-6VbMO21Md7MvWJV4MWqCk--52qKrPDCS23-FKx4jkOjnih5ePakPN-dSTDkGAo4bgzPjROXmDIAUkbQwzhbT6_D4tlNYOQATsBX-KajOoUDgNKG4yybz59Kqg69qvoVpy8mmJ2a8v4 Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 96bc6b8b0235439587a3a5c9e837d708 Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1846238443 Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:21:39.170592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/96bc6b8b0235439587a3a5c9e837d708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/96bc6b8b0235439587a3a5c9e837d708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/96bc6b8b0235439587a3a5c9e837d708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_96bc6b8b0235439587a3a5c9e837d708", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesSnapshotTestJSON-1846238443 Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 96bc6b8b0235439587a3a5c9e837d708 Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1846238443 Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesSnapshotTestJSON-1846238443-project Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 65f1d0ab53de4473acee63b55bf14cab Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesSnapshotTestJSON-1846238443-project Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance ef800788-96b8-4498-b1ec-3c1d79859356 could not be found. Jul 04 09:21:39.172077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'ef800788-96b8-4498-b1ec-3c1d79859356'} Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef800788-96b8-4498-b1ec-3c1d79859356 could not be found. Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:21:39.172985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef800788-96b8-4498-b1ec-3c1d79859356 could not be found. Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef800788-96b8-4498-b1ec-3c1d79859356 could not be found. Jul 04 09:21:39.174439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:21:39.176754 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-85de1208-e947-4186-b281-f8bb5f4ce3fe tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Returning 404 to user: Instance ef800788-96b8-4498-b1ec-3c1d79859356 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:21:39.177823 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-85de1208-e947-4186-b281-f8bb5f4ce3fe tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356" status: 404 len: 111 microversion: 2.1 time: 0.058107 Jul 04 09:21:39.182609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 182/341] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:39 2022] GET /compute/v2.1/servers/ef800788-96b8-4498-b1ec-3c1d79859356 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:21:39.228881 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8ce4a195-ac3c-4da2-ad05-83c871121623 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:39.238786 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8ce4a195-ac3c-4da2-ad05-83c871121623 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.307568 Jul 04 09:21:39.239761 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 160/342] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:38 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:40.085058 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a71c2ab4-96bc-49ab-9b7b-e52a74c12975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:40.085808 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a71c2ab4-96bc-49ab-9b7b-e52a74c12975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:40.097149 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a71c2ab4-96bc-49ab-9b7b-e52a74c12975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:40.097879 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a71c2ab4-96bc-49ab-9b7b-e52a74c12975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:40.098837 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a71c2ab4-96bc-49ab-9b7b-e52a74c12975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:40.099432 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a71c2ab4-96bc-49ab-9b7b-e52a74c12975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:40.257139 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7db2bf59-a886-461d-82fd-894dd4a8808b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:40.258426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7db2bf59-a886-461d-82fd-894dd4a8808b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:40.267416 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7db2bf59-a886-461d-82fd-894dd4a8808b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:40.269153 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7db2bf59-a886-461d-82fd-894dd4a8808b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:40.271890 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7db2bf59-a886-461d-82fd-894dd4a8808b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:40.271890 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7db2bf59-a886-461d-82fd-894dd4a8808b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:40.281476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a71c2ab4-96bc-49ab-9b7b-e52a74c12975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:40.291754 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a71c2ab4-96bc-49ab-9b7b-e52a74c12975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:40.295182 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a71c2ab4-96bc-49ab-9b7b-e52a74c12975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:40.296766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a71c2ab4-96bc-49ab-9b7b-e52a74c12975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.218565 Jul 04 09:21:40.297543 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 183/343] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:40 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:40.506454 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7db2bf59-a886-461d-82fd-894dd4a8808b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:40.515896 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7db2bf59-a886-461d-82fd-894dd4a8808b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.262963 Jul 04 09:21:40.517141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 161/344] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:40 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:41.315634 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0d54b572-1084-43d2-b5e6-6255ca1f9ec5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:41.317030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0d54b572-1084-43d2-b5e6-6255ca1f9ec5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:41.336969 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d54b572-1084-43d2-b5e6-6255ca1f9ec5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:41.337840 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d54b572-1084-43d2-b5e6-6255ca1f9ec5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:41.338881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d54b572-1084-43d2-b5e6-6255ca1f9ec5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:41.339848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0d54b572-1084-43d2-b5e6-6255ca1f9ec5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:41.507132 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0d54b572-1084-43d2-b5e6-6255ca1f9ec5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:41.516703 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0d54b572-1084-43d2-b5e6-6255ca1f9ec5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:41.519774 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0d54b572-1084-43d2-b5e6-6255ca1f9ec5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:41.521293 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0d54b572-1084-43d2-b5e6-6255ca1f9ec5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.209471 Jul 04 09:21:41.523696 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 184/345] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:41 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:41.533310 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cd18430f-1af0-484f-a972-0a32bc499b1e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:41.533922 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cd18430f-1af0-484f-a972-0a32bc499b1e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:41.554405 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd18430f-1af0-484f-a972-0a32bc499b1e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:41.556023 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd18430f-1af0-484f-a972-0a32bc499b1e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:41.557706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd18430f-1af0-484f-a972-0a32bc499b1e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:41.558354 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd18430f-1af0-484f-a972-0a32bc499b1e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:41.797909 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cd18430f-1af0-484f-a972-0a32bc499b1e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:41.806569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cd18430f-1af0-484f-a972-0a32bc499b1e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.277191 Jul 04 09:21:41.818133 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 162/346] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:41 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:42.541874 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b0b4deed-8923-4653-9a2e-35d91e038d80 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:42.543046 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b0b4deed-8923-4653-9a2e-35d91e038d80 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:42.561375 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b0b4deed-8923-4653-9a2e-35d91e038d80 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:42.562151 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b0b4deed-8923-4653-9a2e-35d91e038d80 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:42.563155 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b0b4deed-8923-4653-9a2e-35d91e038d80 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:42.563774 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b0b4deed-8923-4653-9a2e-35d91e038d80 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:42.728931 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b0b4deed-8923-4653-9a2e-35d91e038d80 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:42.749429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b0b4deed-8923-4653-9a2e-35d91e038d80 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:42.751659 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b0b4deed-8923-4653-9a2e-35d91e038d80 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:42.752873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b0b4deed-8923-4653-9a2e-35d91e038d80 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.214890 Jul 04 09:21:42.753840 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 185/347] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:42 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:42.824428 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d914dc07-9c2a-46e1-a5b2-174a1568b030 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:42.825141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d914dc07-9c2a-46e1-a5b2-174a1568b030 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:42.836777 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d914dc07-9c2a-46e1-a5b2-174a1568b030 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:42.839050 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d914dc07-9c2a-46e1-a5b2-174a1568b030 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:42.843187 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d914dc07-9c2a-46e1-a5b2-174a1568b030 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:42.844253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d914dc07-9c2a-46e1-a5b2-174a1568b030 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:43.263326 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d914dc07-9c2a-46e1-a5b2-174a1568b030 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:43.279202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d914dc07-9c2a-46e1-a5b2-174a1568b030 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.458562 Jul 04 09:21:43.279794 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 163/348] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:42 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:43.771662 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0848a250-c47d-4477-8c5b-d97734d70738 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:43.772284 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0848a250-c47d-4477-8c5b-d97734d70738 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:43.781823 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0848a250-c47d-4477-8c5b-d97734d70738 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:43.782284 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0848a250-c47d-4477-8c5b-d97734d70738 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:43.783073 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0848a250-c47d-4477-8c5b-d97734d70738 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:43.785995 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0848a250-c47d-4477-8c5b-d97734d70738 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.023464 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0848a250-c47d-4477-8c5b-d97734d70738 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:44.038647 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0848a250-c47d-4477-8c5b-d97734d70738 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:44.040513 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0848a250-c47d-4477-8c5b-d97734d70738 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:44.042034 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0848a250-c47d-4477-8c5b-d97734d70738 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.274268 Jul 04 09:21:44.043913 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 186/349] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:43 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:44.300469 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-def12ab5-3fff-4bf0-8e63-e3837d6be12c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:44.301375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-def12ab5-3fff-4bf0-8e63-e3837d6be12c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:44.317434 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-def12ab5-3fff-4bf0-8e63-e3837d6be12c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.318039 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-def12ab5-3fff-4bf0-8e63-e3837d6be12c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.319087 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-def12ab5-3fff-4bf0-8e63-e3837d6be12c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:44.319674 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-def12ab5-3fff-4bf0-8e63-e3837d6be12c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:44.523835 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-def12ab5-3fff-4bf0-8e63-e3837d6be12c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:44.540987 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-def12ab5-3fff-4bf0-8e63-e3837d6be12c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.245008 Jul 04 09:21:44.541633 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 164/350] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:44 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:45.061741 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-713271c2-ed79-4e1a-8f91-41b6d7ce4a52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:45.063969 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-713271c2-ed79-4e1a-8f91-41b6d7ce4a52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:45.072158 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-713271c2-ed79-4e1a-8f91-41b6d7ce4a52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:45.073139 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-713271c2-ed79-4e1a-8f91-41b6d7ce4a52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:45.074631 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-713271c2-ed79-4e1a-8f91-41b6d7ce4a52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:45.075654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-713271c2-ed79-4e1a-8f91-41b6d7ce4a52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:45.246589 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-713271c2-ed79-4e1a-8f91-41b6d7ce4a52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:45.255116 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-713271c2-ed79-4e1a-8f91-41b6d7ce4a52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:45.256618 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-713271c2-ed79-4e1a-8f91-41b6d7ce4a52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:45.257806 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-713271c2-ed79-4e1a-8f91-41b6d7ce4a52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.200773 Jul 04 09:21:45.258356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 187/351] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:45 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:45.559104 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ae29cf51-5458-4ac4-a133-a62518f9a1d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:45.559719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ae29cf51-5458-4ac4-a133-a62518f9a1d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:45.568395 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae29cf51-5458-4ac4-a133-a62518f9a1d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:45.574725 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae29cf51-5458-4ac4-a133-a62518f9a1d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:45.575541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae29cf51-5458-4ac4-a133-a62518f9a1d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:45.576023 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae29cf51-5458-4ac4-a133-a62518f9a1d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:45.592515 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:45.718529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ae29cf51-5458-4ac4-a133-a62518f9a1d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:45.727029 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ae29cf51-5458-4ac4-a133-a62518f9a1d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.172612 Jul 04 09:21:45.727603 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 165/352] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:45 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:46.276143 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b79d89f1-2e2b-4436-ae1a-9df4ae0c993b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:46.277341 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b79d89f1-2e2b-4436-ae1a-9df4ae0c993b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:46.284296 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b79d89f1-2e2b-4436-ae1a-9df4ae0c993b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:46.284745 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b79d89f1-2e2b-4436-ae1a-9df4ae0c993b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:46.285569 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b79d89f1-2e2b-4436-ae1a-9df4ae0c993b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:46.286011 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b79d89f1-2e2b-4436-ae1a-9df4ae0c993b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:46.433914 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b79d89f1-2e2b-4436-ae1a-9df4ae0c993b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:46.445545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b79d89f1-2e2b-4436-ae1a-9df4ae0c993b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:46.447213 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b79d89f1-2e2b-4436-ae1a-9df4ae0c993b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:46.448477 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b79d89f1-2e2b-4436-ae1a-9df4ae0c993b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.176389 Jul 04 09:21:46.449600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 188/353] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:46 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:46.744981 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e9b35e71-8ca7-4bd0-8717-3e4db2f89e25 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:46.746776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e9b35e71-8ca7-4bd0-8717-3e4db2f89e25 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:46.753620 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e9b35e71-8ca7-4bd0-8717-3e4db2f89e25 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:46.754359 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e9b35e71-8ca7-4bd0-8717-3e4db2f89e25 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:46.755437 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e9b35e71-8ca7-4bd0-8717-3e4db2f89e25 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:46.755992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e9b35e71-8ca7-4bd0-8717-3e4db2f89e25 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:46.906199 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e9b35e71-8ca7-4bd0-8717-3e4db2f89e25 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:46.914776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e9b35e71-8ca7-4bd0-8717-3e4db2f89e25 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.173580 Jul 04 09:21:46.926082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 166/354] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:46 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:47.471200 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bb5200a4-1ddd-4bf1-82ef-ffbe103c36e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:47.472323 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bb5200a4-1ddd-4bf1-82ef-ffbe103c36e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:47.484403 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb5200a4-1ddd-4bf1-82ef-ffbe103c36e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:47.484853 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb5200a4-1ddd-4bf1-82ef-ffbe103c36e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:47.485672 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb5200a4-1ddd-4bf1-82ef-ffbe103c36e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:47.486169 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bb5200a4-1ddd-4bf1-82ef-ffbe103c36e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:47.681860 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bb5200a4-1ddd-4bf1-82ef-ffbe103c36e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:47.696050 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bb5200a4-1ddd-4bf1-82ef-ffbe103c36e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:47.698297 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bb5200a4-1ddd-4bf1-82ef-ffbe103c36e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:47.705107 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-58c14638-43e7-4e90-a9c4-5b708de19468 req-a7624f30-8507-4136-a09a-4b44aca243d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8dcc08-23ef-46ee-b941-55a7f1716d41", "name": "network-vif-unplugged", "status": "completed", "tag": "170feb05-63b9-496e-b589-498558ed153c"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:47.715397 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bb5200a4-1ddd-4bf1-82ef-ffbe103c36e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.247773 Jul 04 09:21:47.716050 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 189/355] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:47 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:47.718484 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-58c14638-43e7-4e90-a9c4-5b708de19468 req-a7624f30-8507-4136-a09a-4b44aca243d6 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:47.719186 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-58c14638-43e7-4e90-a9c4-5b708de19468 req-a7624f30-8507-4136-a09a-4b44aca243d6 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:47.742604 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-58c14638-43e7-4e90-a9c4-5b708de19468 req-a7624f30-8507-4136-a09a-4b44aca243d6 service nova] Creating event network-vif-unplugged:170feb05-63b9-496e-b589-498558ed153c for instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 on hv-cinder-84456 Jul 04 09:21:47.750212 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-58c14638-43e7-4e90-a9c4-5b708de19468 req-a7624f30-8507-4136-a09a-4b44aca243d6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049322 Jul 04 09:21:47.751895 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 167/356] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:47.933930 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-942d094f-ee0a-4410-b3a7-5622d2b28ae5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:47.935286 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-942d094f-ee0a-4410-b3a7-5622d2b28ae5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:47.943537 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-942d094f-ee0a-4410-b3a7-5622d2b28ae5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:47.944474 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-942d094f-ee0a-4410-b3a7-5622d2b28ae5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:47.945289 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-942d094f-ee0a-4410-b3a7-5622d2b28ae5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:47.945736 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-942d094f-ee0a-4410-b3a7-5622d2b28ae5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:48.098432 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-942d094f-ee0a-4410-b3a7-5622d2b28ae5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:48.110739 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-942d094f-ee0a-4410-b3a7-5622d2b28ae5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.182506 Jul 04 09:21:48.111484 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 190/357] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:47 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:48.737361 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d1692498-2704-47e6-a18f-68e6dec27a39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:48.738327 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d1692498-2704-47e6-a18f-68e6dec27a39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:48.749098 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d1692498-2704-47e6-a18f-68e6dec27a39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:48.749879 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d1692498-2704-47e6-a18f-68e6dec27a39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:48.750866 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d1692498-2704-47e6-a18f-68e6dec27a39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:48.751484 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d1692498-2704-47e6-a18f-68e6dec27a39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:48.908507 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d1692498-2704-47e6-a18f-68e6dec27a39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:48.919178 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d1692498-2704-47e6-a18f-68e6dec27a39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:48.920773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d1692498-2704-47e6-a18f-68e6dec27a39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:48.922001 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d1692498-2704-47e6-a18f-68e6dec27a39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1740 microversion: 2.20 time: 0.190789 Jul 04 09:21:48.925331 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 168/358] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:48 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:49.130594 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-73c35078-e843-4774-9e7c-df597d522658 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:49.131017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-73c35078-e843-4774-9e7c-df597d522658 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:49.139957 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73c35078-e843-4774-9e7c-df597d522658 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:49.140421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73c35078-e843-4774-9e7c-df597d522658 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:49.141244 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73c35078-e843-4774-9e7c-df597d522658 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:49.141683 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73c35078-e843-4774-9e7c-df597d522658 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:49.303028 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-73c35078-e843-4774-9e7c-df597d522658 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:49.313135 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-73c35078-e843-4774-9e7c-df597d522658 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.186847 Jul 04 09:21:49.314935 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 191/359] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:49 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:49.594579 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1828978223", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "networks": [{"uuid": "7751e8e2-d957-4c46-b550-d3472313f135"}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:49.654180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] validate_networks() for [('7751e8e2-d957-4c46-b550-d3472313f135', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:21:49.940338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c981fefa-c8fd-4ac1-9e31-e64bac651f2c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:49.940907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c981fefa-c8fd-4ac1-9e31-e64bac651f2c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:49.947040 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c981fefa-c8fd-4ac1-9e31-e64bac651f2c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:49.947485 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c981fefa-c8fd-4ac1-9e31-e64bac651f2c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:49.948255 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c981fefa-c8fd-4ac1-9e31-e64bac651f2c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:49.948876 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c981fefa-c8fd-4ac1-9e31-e64bac651f2c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:49.954641 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:50.100681 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:21:50.101239 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:21:50.101716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:21:50.102137 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:21:50.102556 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:21:50.112855 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:50.113346 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:50.114167 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:50.114610 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:50.131099 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c981fefa-c8fd-4ac1-9e31-e64bac651f2c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:50.132379 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Getting quotas for project 96bc6b8b0235439587a3a5c9e837d708. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:21:50.137905 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Getting quotas for user 65f1d0ab53de4473acee63b55bf14cab and project 96bc6b8b0235439587a3a5c9e837d708. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:21:50.141467 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c981fefa-c8fd-4ac1-9e31-e64bac651f2c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:50.143212 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c981fefa-c8fd-4ac1-9e31-e64bac651f2c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:50.144462 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c981fefa-c8fd-4ac1-9e31-e64bac651f2c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1722 microversion: 2.20 time: 0.208067 Jul 04 09:21:50.145595 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 192/360] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:49 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:50.150125 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:21:50.153286 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:21:50.201922 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b0b16726-9453-4f2a-9f22-f9b5da5a4c67 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612116 Jul 04 09:21:50.202529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 169/361] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:21:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:21:50.212408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0ed2314f-f939-4cdb-a35a-af5d3c909764 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:50.213074 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0ed2314f-f939-4cdb-a35a-af5d3c909764 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:50.283616 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0ed2314f-f939-4cdb-a35a-af5d3c909764 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:50.291528 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0ed2314f-f939-4cdb-a35a-af5d3c909764 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1219 microversion: 2.1 time: 0.082893 Jul 04 09:21:50.292598 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 193/362] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:50 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:50.333832 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-599f7826-e1bc-425f-a6c7-4ef750a9c1ff tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:50.334451 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-599f7826-e1bc-425f-a6c7-4ef750a9c1ff tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:50.342277 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-599f7826-e1bc-425f-a6c7-4ef750a9c1ff tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:50.342673 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-599f7826-e1bc-425f-a6c7-4ef750a9c1ff tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:50.343688 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-599f7826-e1bc-425f-a6c7-4ef750a9c1ff tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:50.344183 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-599f7826-e1bc-425f-a6c7-4ef750a9c1ff tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:50.503169 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-599f7826-e1bc-425f-a6c7-4ef750a9c1ff tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:50.512886 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-599f7826-e1bc-425f-a6c7-4ef750a9c1ff tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.182892 Jul 04 09:21:50.513623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 170/363] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:50 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:51.163965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ba4babdc-cb8f-4eb7-a06b-109c8bce24d2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:51.164904 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ba4babdc-cb8f-4eb7-a06b-109c8bce24d2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:51.173769 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba4babdc-cb8f-4eb7-a06b-109c8bce24d2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:51.174252 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba4babdc-cb8f-4eb7-a06b-109c8bce24d2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:51.175048 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba4babdc-cb8f-4eb7-a06b-109c8bce24d2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:51.175532 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba4babdc-cb8f-4eb7-a06b-109c8bce24d2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:51.309464 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e0e8839a-2c72-4430-ae58-d033b9952e5a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:51.310223 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e0e8839a-2c72-4430-ae58-d033b9952e5a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:51.311209 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ba4babdc-cb8f-4eb7-a06b-109c8bce24d2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:51.317527 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0e8839a-2c72-4430-ae58-d033b9952e5a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:51.317986 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0e8839a-2c72-4430-ae58-d033b9952e5a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:51.318753 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0e8839a-2c72-4430-ae58-d033b9952e5a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:51.319289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0e8839a-2c72-4430-ae58-d033b9952e5a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:51.319700 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ba4babdc-cb8f-4eb7-a06b-109c8bce24d2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:51.321227 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ba4babdc-cb8f-4eb7-a06b-109c8bce24d2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:51.322383 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ba4babdc-cb8f-4eb7-a06b-109c8bce24d2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1722 microversion: 2.20 time: 0.162695 Jul 04 09:21:51.324287 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 194/364] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:51 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:51.389131 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e0e8839a-2c72-4430-ae58-d033b9952e5a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:51.398008 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e0e8839a-2c72-4430-ae58-d033b9952e5a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1215 microversion: 2.1 time: 0.092513 Jul 04 09:21:51.398545 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 171/365] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:51 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:51.532125 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f0782dc4-5550-480e-bde1-df788369a8e5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:51.532873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f0782dc4-5550-480e-bde1-df788369a8e5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:51.539487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0782dc4-5550-480e-bde1-df788369a8e5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:51.539935 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0782dc4-5550-480e-bde1-df788369a8e5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:51.540712 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0782dc4-5550-480e-bde1-df788369a8e5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:51.541200 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f0782dc4-5550-480e-bde1-df788369a8e5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:51.673244 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f0782dc4-5550-480e-bde1-df788369a8e5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:51.680654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f0782dc4-5550-480e-bde1-df788369a8e5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.154141 Jul 04 09:21:51.681246 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 195/366] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:51 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:52.342103 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f5346bb5-18d1-493e-9f4b-443c780752b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:52.342711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f5346bb5-18d1-493e-9f4b-443c780752b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:52.349190 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5346bb5-18d1-493e-9f4b-443c780752b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:52.349638 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5346bb5-18d1-493e-9f4b-443c780752b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:52.350427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5346bb5-18d1-493e-9f4b-443c780752b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:52.350858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5346bb5-18d1-493e-9f4b-443c780752b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:52.415136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-48ad8d28-ec97-415d-8f54-ec0bb8950b66 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:52.415758 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-48ad8d28-ec97-415d-8f54-ec0bb8950b66 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:52.422822 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48ad8d28-ec97-415d-8f54-ec0bb8950b66 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:52.423274 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48ad8d28-ec97-415d-8f54-ec0bb8950b66 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:52.424043 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48ad8d28-ec97-415d-8f54-ec0bb8950b66 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:52.424479 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48ad8d28-ec97-415d-8f54-ec0bb8950b66 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:52.497354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-48ad8d28-ec97-415d-8f54-ec0bb8950b66 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:52.505759 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-48ad8d28-ec97-415d-8f54-ec0bb8950b66 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1215 microversion: 2.1 time: 0.094350 Jul 04 09:21:52.506348 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 196/367] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:52 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:52.510361 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f5346bb5-18d1-493e-9f4b-443c780752b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:52.519076 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f5346bb5-18d1-493e-9f4b-443c780752b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:52.520568 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f5346bb5-18d1-493e-9f4b-443c780752b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:52.521735 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f5346bb5-18d1-493e-9f4b-443c780752b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1722 microversion: 2.20 time: 0.184423 Jul 04 09:21:52.522278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 172/368] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:52 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:52.697257 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9acaa94c-1035-4575-98c3-a15e2dd0615b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:52.697965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9acaa94c-1035-4575-98c3-a15e2dd0615b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:52.704370 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9acaa94c-1035-4575-98c3-a15e2dd0615b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:52.704898 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9acaa94c-1035-4575-98c3-a15e2dd0615b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:52.705780 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9acaa94c-1035-4575-98c3-a15e2dd0615b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:52.706286 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9acaa94c-1035-4575-98c3-a15e2dd0615b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:52.924877 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9acaa94c-1035-4575-98c3-a15e2dd0615b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:52.933492 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9acaa94c-1035-4575-98c3-a15e2dd0615b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1520 microversion: 2.1 time: 0.240845 Jul 04 09:21:52.943406 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 197/369] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:52 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:53.528447 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1ae91919-0b8b-415d-8c13-ac445a47e949 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:53.529568 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1ae91919-0b8b-415d-8c13-ac445a47e949 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:53.537555 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ae91919-0b8b-415d-8c13-ac445a47e949 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:53.538010 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ae91919-0b8b-415d-8c13-ac445a47e949 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:53.538927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ae91919-0b8b-415d-8c13-ac445a47e949 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:53.539372 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ae91919-0b8b-415d-8c13-ac445a47e949 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:53.539772 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-26b98052-49c3-42a0-adc5-0db8ff6a4d48 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:53.540388 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-26b98052-49c3-42a0-adc5-0db8ff6a4d48 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:53.548500 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26b98052-49c3-42a0-adc5-0db8ff6a4d48 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:53.549239 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26b98052-49c3-42a0-adc5-0db8ff6a4d48 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:53.550183 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26b98052-49c3-42a0-adc5-0db8ff6a4d48 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:53.550782 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26b98052-49c3-42a0-adc5-0db8ff6a4d48 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:53.614741 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1ae91919-0b8b-415d-8c13-ac445a47e949 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:53.624759 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1ae91919-0b8b-415d-8c13-ac445a47e949 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1271 microversion: 2.1 time: 0.104831 Jul 04 09:21:53.625674 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 173/370] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:53 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:53.700773 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-26b98052-49c3-42a0-adc5-0db8ff6a4d48 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:53.708621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-26b98052-49c3-42a0-adc5-0db8ff6a4d48 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:53.710164 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-26b98052-49c3-42a0-adc5-0db8ff6a4d48 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:53.711346 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-26b98052-49c3-42a0-adc5-0db8ff6a4d48 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1725 microversion: 2.20 time: 0.175551 Jul 04 09:21:53.711899 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 198/371] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:53 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:53.729387 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-69f99fab-e24a-4fc4-92d2-47c1af59c0e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84050e97-d917-43ad-b3b5-182f8b33715e"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:53.731240 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-69f99fab-e24a-4fc4-92d2-47c1af59c0e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:53.737932 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-69f99fab-e24a-4fc4-92d2-47c1af59c0e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:53.738393 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-69f99fab-e24a-4fc4-92d2-47c1af59c0e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:53.739169 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-69f99fab-e24a-4fc4-92d2-47c1af59c0e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:53.739640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-69f99fab-e24a-4fc4-92d2-47c1af59c0e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:53.950360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a21a5d0b-41e2-4088-8c72-79c32d651c05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:53.951004 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a21a5d0b-41e2-4088-8c72-79c32d651c05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:53.957177 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a21a5d0b-41e2-4088-8c72-79c32d651c05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:53.957637 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a21a5d0b-41e2-4088-8c72-79c32d651c05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:53.958659 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a21a5d0b-41e2-4088-8c72-79c32d651c05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:53.959111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a21a5d0b-41e2-4088-8c72-79c32d651c05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.073564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-69f99fab-e24a-4fc4-92d2-47c1af59c0e5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "POST /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.348185 Jul 04 09:21:54.078687 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 174/372] 10.222.0.71 () {62 vars in 1363 bytes} [Mon Jul 4 09:21:53 2022] POST /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-volume_attachments => generated 188 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:21:54.159717 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a21a5d0b-41e2-4088-8c72-79c32d651c05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:54.173202 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a21a5d0b-41e2-4088-8c72-79c32d651c05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1500 microversion: 2.1 time: 0.226107 Jul 04 09:21:54.174689 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 199/373] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:53 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1500 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:54.194386 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2a7114cb-003d-4896-839d-204b112da796 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:54.195011 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2a7114cb-003d-4896-839d-204b112da796 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:54.212913 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a7114cb-003d-4896-839d-204b112da796 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:54.213403 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a7114cb-003d-4896-839d-204b112da796 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.216573 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a7114cb-003d-4896-839d-204b112da796 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:54.217071 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a7114cb-003d-4896-839d-204b112da796 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.291822 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-59ab95df-d45e-4a25-a31f-cb46d2d59ace tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:54.293160 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-59ab95df-d45e-4a25-a31f-cb46d2d59ace tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:54.304853 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-59ab95df-d45e-4a25-a31f-cb46d2d59ace tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:54.305802 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-59ab95df-d45e-4a25-a31f-cb46d2d59ace tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.308006 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-59ab95df-d45e-4a25-a31f-cb46d2d59ace tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:54.311418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-59ab95df-d45e-4a25-a31f-cb46d2d59ace tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.413240 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2a7114cb-003d-4896-839d-204b112da796 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:54.426163 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2a7114cb-003d-4896-839d-204b112da796 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1516 microversion: 2.1 time: 0.235505 Jul 04 09:21:54.427112 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 175/374] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:54 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:54.482124 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-59ab95df-d45e-4a25-a31f-cb46d2d59ace tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "POST /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/action" status: 202 len: 0 microversion: 2.20 time: 0.194641 Jul 04 09:21:54.483269 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 200/375] 10.222.0.71 () {62 vars in 1318 bytes} [Mon Jul 4 09:21:54 2022] POST /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 04 09:21:54.497371 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-41fac87b-e0d2-4ce5-a039-9fe4b026e89e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:54.498012 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-41fac87b-e0d2-4ce5-a039-9fe4b026e89e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:54.509897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41fac87b-e0d2-4ce5-a039-9fe4b026e89e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:54.509897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41fac87b-e0d2-4ce5-a039-9fe4b026e89e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.509897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41fac87b-e0d2-4ce5-a039-9fe4b026e89e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:54.509897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41fac87b-e0d2-4ce5-a039-9fe4b026e89e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.644760 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3c73f4c9-2bdf-460d-855e-9aacba60d671 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:54.646081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3c73f4c9-2bdf-460d-855e-9aacba60d671 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:54.659997 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c73f4c9-2bdf-460d-855e-9aacba60d671 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:54.661944 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c73f4c9-2bdf-460d-855e-9aacba60d671 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.663065 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c73f4c9-2bdf-460d-855e-9aacba60d671 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:54.664448 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3c73f4c9-2bdf-460d-855e-9aacba60d671 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:54.813533 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-41fac87b-e0d2-4ce5-a039-9fe4b026e89e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:54.829344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-41fac87b-e0d2-4ce5-a039-9fe4b026e89e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:54.832310 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-41fac87b-e0d2-4ce5-a039-9fe4b026e89e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:54.834652 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-41fac87b-e0d2-4ce5-a039-9fe4b026e89e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1751 microversion: 2.20 time: 0.347493 Jul 04 09:21:54.835664 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 176/376] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:54 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1751 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:54.854025 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3c73f4c9-2bdf-460d-855e-9aacba60d671 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:54.863378 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3c73f4c9-2bdf-460d-855e-9aacba60d671 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1277 microversion: 2.1 time: 0.223851 Jul 04 09:21:54.864418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 201/377] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:54 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:21:55.775289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-c7fe4396-a647-4919-92f5-36301af5f6a9 req-12658c64-16a5-4269-81b3-19efefaaf64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "005a3614-439a-4f93-8af0-69956acdcd99", "tag": "99842618-f7e3-45be-a5c4-915798a01e04"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:55.793148 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-c7fe4396-a647-4919-92f5-36301af5f6a9 req-12658c64-16a5-4269-81b3-19efefaaf64f service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:55.794446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-c7fe4396-a647-4919-92f5-36301af5f6a9 req-12658c64-16a5-4269-81b3-19efefaaf64f service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:55.806952 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-c7fe4396-a647-4919-92f5-36301af5f6a9 req-12658c64-16a5-4269-81b3-19efefaaf64f service nova] Creating event network-changed:99842618-f7e3-45be-a5c4-915798a01e04 for instance 005a3614-439a-4f93-8af0-69956acdcd99 on hv-cinder-84456 Jul 04 09:21:55.815945 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-c7fe4396-a647-4919-92f5-36301af5f6a9 req-12658c64-16a5-4269-81b3-19efefaaf64f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048741 Jul 04 09:21:55.817544 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 177/378] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:21:55.855966 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5dcfb1b7-dd82-4963-8adf-4f0f6d3c2f5e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:55.857354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5dcfb1b7-dd82-4963-8adf-4f0f6d3c2f5e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:55.868945 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5dcfb1b7-dd82-4963-8adf-4f0f6d3c2f5e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:55.869437 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5dcfb1b7-dd82-4963-8adf-4f0f6d3c2f5e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:55.870257 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5dcfb1b7-dd82-4963-8adf-4f0f6d3c2f5e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:55.870716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5dcfb1b7-dd82-4963-8adf-4f0f6d3c2f5e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:55.881709 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c1ed234b-d4fa-4b04-a259-00422bd916a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:55.882408 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c1ed234b-d4fa-4b04-a259-00422bd916a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:55.899234 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1ed234b-d4fa-4b04-a259-00422bd916a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:55.899681 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1ed234b-d4fa-4b04-a259-00422bd916a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:55.900678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1ed234b-d4fa-4b04-a259-00422bd916a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:55.901184 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c1ed234b-d4fa-4b04-a259-00422bd916a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:56.111348 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5dcfb1b7-dd82-4963-8adf-4f0f6d3c2f5e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:56.111906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c1ed234b-d4fa-4b04-a259-00422bd916a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:56.119752 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c1ed234b-d4fa-4b04-a259-00422bd916a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.242203 Jul 04 09:21:56.120342 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 178/379] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:55 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:56.129150 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dcd35f6c-9180-43f9-8aba-c11875eb9d88 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:21:56.129150 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dcd35f6c-9180-43f9-8aba-c11875eb9d88 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:56.133020 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dcd35f6c-9180-43f9-8aba-c11875eb9d88 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:56.133507 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dcd35f6c-9180-43f9-8aba-c11875eb9d88 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:56.134267 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dcd35f6c-9180-43f9-8aba-c11875eb9d88 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:56.134700 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dcd35f6c-9180-43f9-8aba-c11875eb9d88 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:56.137185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5dcfb1b7-dd82-4963-8adf-4f0f6d3c2f5e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:56.139148 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5dcfb1b7-dd82-4963-8adf-4f0f6d3c2f5e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:56.142950 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5dcfb1b7-dd82-4963-8adf-4f0f6d3c2f5e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1751 microversion: 2.20 time: 0.292025 Jul 04 09:21:56.144118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 202/380] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:55 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1751 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:56.160769 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-dcd35f6c-9180-43f9-8aba-c11875eb9d88 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lazy-loading 'flavor' on Instance uuid be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:21:56.216585 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:21:56.243427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dcd35f6c-9180-43f9-8aba-c11875eb9d88 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce/action" status: 200 len: 32 microversion: 2.1 time: 0.121234 Jul 04 09:21:56.243952 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 179/381] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:21:56 2022] POST /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce/action => generated 32 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:21:56.256398 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d2e8c46d-842d-4a0d-89e2-c2b0d6578876 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:56.257311 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d2e8c46d-842d-4a0d-89e2-c2b0d6578876 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:56.267111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2e8c46d-842d-4a0d-89e2-c2b0d6578876 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:56.267571 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2e8c46d-842d-4a0d-89e2-c2b0d6578876 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:56.268411 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2e8c46d-842d-4a0d-89e2-c2b0d6578876 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:56.268853 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2e8c46d-842d-4a0d-89e2-c2b0d6578876 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:56.407391 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d2e8c46d-842d-4a0d-89e2-c2b0d6578876 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:56.415366 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d2e8c46d-842d-4a0d-89e2-c2b0d6578876 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.163775 Jul 04 09:21:56.415941 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 203/382] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:56 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:57.138030 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e5c03075-4db2-42d2-ba2e-a9004f7b65f5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:57.138738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e5c03075-4db2-42d2-ba2e-a9004f7b65f5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:57.145127 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5c03075-4db2-42d2-ba2e-a9004f7b65f5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:57.145581 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5c03075-4db2-42d2-ba2e-a9004f7b65f5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:57.146348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5c03075-4db2-42d2-ba2e-a9004f7b65f5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:57.146791 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5c03075-4db2-42d2-ba2e-a9004f7b65f5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:57.161922 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c8c12698-c74d-4358-a2a6-6120c3e0b576 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:57.162531 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c8c12698-c74d-4358-a2a6-6120c3e0b576 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:57.170238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c8c12698-c74d-4358-a2a6-6120c3e0b576 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:57.170691 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c8c12698-c74d-4358-a2a6-6120c3e0b576 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:57.171463 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c8c12698-c74d-4358-a2a6-6120c3e0b576 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:57.171902 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c8c12698-c74d-4358-a2a6-6120c3e0b576 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:57.338707 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e5c03075-4db2-42d2-ba2e-a9004f7b65f5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:57.346940 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e5c03075-4db2-42d2-ba2e-a9004f7b65f5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.213932 Jul 04 09:21:57.347598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 180/383] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:57 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:57.355678 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c8c12698-c74d-4358-a2a6-6120c3e0b576 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:57.364115 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c8c12698-c74d-4358-a2a6-6120c3e0b576 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:57.365971 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c8c12698-c74d-4358-a2a6-6120c3e0b576 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:57.367246 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c8c12698-c74d-4358-a2a6-6120c3e0b576 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1753 microversion: 2.20 time: 0.209180 Jul 04 09:21:57.367938 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 204/384] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:57 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1753 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:57.432285 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c57f0f91-1c46-4f16-8f3a-404f8c0f1a06 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:57.432895 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c57f0f91-1c46-4f16-8f3a-404f8c0f1a06 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:57.438911 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c57f0f91-1c46-4f16-8f3a-404f8c0f1a06 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:57.439356 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c57f0f91-1c46-4f16-8f3a-404f8c0f1a06 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:57.440113 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c57f0f91-1c46-4f16-8f3a-404f8c0f1a06 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:57.440541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c57f0f91-1c46-4f16-8f3a-404f8c0f1a06 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:57.579562 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c57f0f91-1c46-4f16-8f3a-404f8c0f1a06 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:57.588574 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c57f0f91-1c46-4f16-8f3a-404f8c0f1a06 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.160134 Jul 04 09:21:57.590052 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 181/385] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:57 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:58.363729 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a4f65388-9e9b-4efa-b2fa-e7d581ead0ab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:58.364357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a4f65388-9e9b-4efa-b2fa-e7d581ead0ab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:58.371482 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4f65388-9e9b-4efa-b2fa-e7d581ead0ab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:58.371927 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4f65388-9e9b-4efa-b2fa-e7d581ead0ab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:58.372705 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4f65388-9e9b-4efa-b2fa-e7d581ead0ab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:58.373187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a4f65388-9e9b-4efa-b2fa-e7d581ead0ab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:58.400545 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d758467d-e365-46f8-9b41-cbabc6a5a149 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:58.401411 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d758467d-e365-46f8-9b41-cbabc6a5a149 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:58.408617 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d758467d-e365-46f8-9b41-cbabc6a5a149 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:58.409331 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d758467d-e365-46f8-9b41-cbabc6a5a149 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:58.410195 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d758467d-e365-46f8-9b41-cbabc6a5a149 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:58.410716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d758467d-e365-46f8-9b41-cbabc6a5a149 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:58.588664 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a4f65388-9e9b-4efa-b2fa-e7d581ead0ab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:58.596991 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a4f65388-9e9b-4efa-b2fa-e7d581ead0ab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.237153 Jul 04 09:21:58.597593 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 205/386] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:58 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:58.610933 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4fe2a0a8-79d9-476d-960b-82a70e99e397 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:58.611649 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4fe2a0a8-79d9-476d-960b-82a70e99e397 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:58.618572 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4fe2a0a8-79d9-476d-960b-82a70e99e397 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:58.619324 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4fe2a0a8-79d9-476d-960b-82a70e99e397 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:58.620113 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4fe2a0a8-79d9-476d-960b-82a70e99e397 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:58.620836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4fe2a0a8-79d9-476d-960b-82a70e99e397 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:58.629514 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d758467d-e365-46f8-9b41-cbabc6a5a149 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:58.639971 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d758467d-e365-46f8-9b41-cbabc6a5a149 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:58.641693 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d758467d-e365-46f8-9b41-cbabc6a5a149 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:58.643220 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d758467d-e365-46f8-9b41-cbabc6a5a149 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.254976 Jul 04 09:21:58.644341 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 182/387] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:58 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:21:58.944219 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4fe2a0a8-79d9-476d-960b-82a70e99e397 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:58.952451 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4fe2a0a8-79d9-476d-960b-82a70e99e397 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.345661 Jul 04 09:21:58.953020 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 206/388] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:58 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:59.614408 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5aedb6d7-9381-4ab1-982f-8df59b855b38 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:59.615025 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5aedb6d7-9381-4ab1-982f-8df59b855b38 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:59.621971 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5aedb6d7-9381-4ab1-982f-8df59b855b38 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:59.622661 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5aedb6d7-9381-4ab1-982f-8df59b855b38 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:59.623694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5aedb6d7-9381-4ab1-982f-8df59b855b38 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:59.624328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5aedb6d7-9381-4ab1-982f-8df59b855b38 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:59.664115 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-45fa34a2-17c8-42e6-9dda-82a6726c5503 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:59.666287 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-45fa34a2-17c8-42e6-9dda-82a6726c5503 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:59.674017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-45fa34a2-17c8-42e6-9dda-82a6726c5503 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:59.674799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-45fa34a2-17c8-42e6-9dda-82a6726c5503 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:59.676066 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-45fa34a2-17c8-42e6-9dda-82a6726c5503 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:59.676717 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-45fa34a2-17c8-42e6-9dda-82a6726c5503 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:59.827052 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5aedb6d7-9381-4ab1-982f-8df59b855b38 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:59.835993 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5aedb6d7-9381-4ab1-982f-8df59b855b38 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.225290 Jul 04 09:21:59.836588 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 183/389] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:59 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:21:59.904456 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-45fa34a2-17c8-42e6-9dda-82a6726c5503 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:59.927521 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-45fa34a2-17c8-42e6-9dda-82a6726c5503 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:59.929586 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-45fa34a2-17c8-42e6-9dda-82a6726c5503 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:21:59.930757 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-45fa34a2-17c8-42e6-9dda-82a6726c5503 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.270956 Jul 04 09:21:59.931490 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 207/390] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:21:59 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:21:59.971041 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dd8a1db6-776a-4caa-a4a3-bb4ddc0cec05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:21:59.971901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dd8a1db6-776a-4caa-a4a3-bb4ddc0cec05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:21:59.978791 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd8a1db6-776a-4caa-a4a3-bb4ddc0cec05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:59.979348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd8a1db6-776a-4caa-a4a3-bb4ddc0cec05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:21:59.980347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd8a1db6-776a-4caa-a4a3-bb4ddc0cec05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:21:59.980938 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dd8a1db6-776a-4caa-a4a3-bb4ddc0cec05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:00.122976 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:00.145697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:00.186229 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dd8a1db6-776a-4caa-a4a3-bb4ddc0cec05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:00.194759 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dd8a1db6-776a-4caa-a4a3-bb4ddc0cec05 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.228181 Jul 04 09:22:00.205360 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 184/391] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:21:59 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:00.854656 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-defc533f-9d56-4fc5-9d81-36832071a41e tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:00.855363 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-defc533f-9d56-4fc5-9d81-36832071a41e tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:00.857583 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:00.864336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-defc533f-9d56-4fc5-9d81-36832071a41e tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:00.864983 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-defc533f-9d56-4fc5-9d81-36832071a41e tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:00.865836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-defc533f-9d56-4fc5-9d81-36832071a41e tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:00.866279 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-defc533f-9d56-4fc5-9d81-36832071a41e tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:00.950478 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b5523ccb-3140-4fed-9d37-4360ec20efac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:00.951184 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b5523ccb-3140-4fed-9d37-4360ec20efac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:00.953863 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:00.962223 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5523ccb-3140-4fed-9d37-4360ec20efac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:00.963136 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5523ccb-3140-4fed-9d37-4360ec20efac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:00.965114 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5523ccb-3140-4fed-9d37-4360ec20efac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:00.966848 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5523ccb-3140-4fed-9d37-4360ec20efac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:01.075847 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-defc533f-9d56-4fc5-9d81-36832071a41e tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:01.082885 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:01.085221 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-defc533f-9d56-4fc5-9d81-36832071a41e tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.234874 Jul 04 09:22:01.086370 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 208/392] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:00 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:01.159128 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b5523ccb-3140-4fed-9d37-4360ec20efac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:01.168598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b5523ccb-3140-4fed-9d37-4360ec20efac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:01.174201 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b5523ccb-3140-4fed-9d37-4360ec20efac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:01.174201 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b5523ccb-3140-4fed-9d37-4360ec20efac tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.226745 Jul 04 09:22:01.174201 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 185/393] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:00 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:01.213917 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3cee8b90-1cba-4d3b-8df2-a537be17a0df tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:01.214531 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3cee8b90-1cba-4d3b-8df2-a537be17a0df tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:01.221777 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3cee8b90-1cba-4d3b-8df2-a537be17a0df tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:01.222234 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3cee8b90-1cba-4d3b-8df2-a537be17a0df tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:01.223021 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3cee8b90-1cba-4d3b-8df2-a537be17a0df tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:01.223636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3cee8b90-1cba-4d3b-8df2-a537be17a0df tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:01.391731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3cee8b90-1cba-4d3b-8df2-a537be17a0df tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:01.400093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3cee8b90-1cba-4d3b-8df2-a537be17a0df tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.189975 Jul 04 09:22:01.400687 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 209/394] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:01 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:01.586840 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-10e7b75a-df1d-4602-8cfa-a35423795beb req-e298eb20-6ffc-4f31-8e0c-6658c9901fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "005a3614-439a-4f93-8af0-69956acdcd99", "name": "network-vif-plugged", "status": "completed", "tag": "99842618-f7e3-45be-a5c4-915798a01e04"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:01.596112 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-10e7b75a-df1d-4602-8cfa-a35423795beb req-e298eb20-6ffc-4f31-8e0c-6658c9901fb5 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:01.596568 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-10e7b75a-df1d-4602-8cfa-a35423795beb req-e298eb20-6ffc-4f31-8e0c-6658c9901fb5 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:01.614157 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-10e7b75a-df1d-4602-8cfa-a35423795beb req-e298eb20-6ffc-4f31-8e0c-6658c9901fb5 service nova] Creating event network-vif-plugged:99842618-f7e3-45be-a5c4-915798a01e04 for instance 005a3614-439a-4f93-8af0-69956acdcd99 on hv-cinder-84456 Jul 04 09:22:01.622255 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-10e7b75a-df1d-4602-8cfa-a35423795beb req-e298eb20-6ffc-4f31-8e0c-6658c9901fb5 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038097 Jul 04 09:22:01.623143 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 186/395] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:22:02.103583 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-aa534e9d-88b7-42f5-a632-b069ef051af0 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:02.104852 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-aa534e9d-88b7-42f5-a632-b069ef051af0 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:02.117103 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aa534e9d-88b7-42f5-a632-b069ef051af0 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:02.117558 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aa534e9d-88b7-42f5-a632-b069ef051af0 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:02.118340 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aa534e9d-88b7-42f5-a632-b069ef051af0 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:02.118775 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-aa534e9d-88b7-42f5-a632-b069ef051af0 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:02.191480 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9ec1ef3a-3a3e-4a6c-b6da-ab96ba0f868d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:02.192483 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9ec1ef3a-3a3e-4a6c-b6da-ab96ba0f868d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:02.201698 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ec1ef3a-3a3e-4a6c-b6da-ab96ba0f868d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:02.202154 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ec1ef3a-3a3e-4a6c-b6da-ab96ba0f868d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:02.202936 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ec1ef3a-3a3e-4a6c-b6da-ab96ba0f868d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:02.203375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9ec1ef3a-3a3e-4a6c-b6da-ab96ba0f868d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:02.323622 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-aa534e9d-88b7-42f5-a632-b069ef051af0 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:02.333859 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-aa534e9d-88b7-42f5-a632-b069ef051af0 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.234024 Jul 04 09:22:02.334513 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 210/396] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:02 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:02.374611 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9ec1ef3a-3a3e-4a6c-b6da-ab96ba0f868d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:02.395802 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9ec1ef3a-3a3e-4a6c-b6da-ab96ba0f868d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:02.397346 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9ec1ef3a-3a3e-4a6c-b6da-ab96ba0f868d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:02.398539 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9ec1ef3a-3a3e-4a6c-b6da-ab96ba0f868d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.211804 Jul 04 09:22:02.399102 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 187/397] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:02 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:02.417730 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-328ed234-205f-442b-84db-cafdc8969f75 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:02.419246 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-328ed234-205f-442b-84db-cafdc8969f75 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:02.425495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-328ed234-205f-442b-84db-cafdc8969f75 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:02.425948 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-328ed234-205f-442b-84db-cafdc8969f75 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:02.426730 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-328ed234-205f-442b-84db-cafdc8969f75 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:02.427222 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-328ed234-205f-442b-84db-cafdc8969f75 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:02.592005 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-328ed234-205f-442b-84db-cafdc8969f75 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:02.601694 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-328ed234-205f-442b-84db-cafdc8969f75 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.187868 Jul 04 09:22:02.602278 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 211/398] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:02 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:03.351228 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7d2beb79-c832-4ff2-bd79-88e28018ceab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:03.351868 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7d2beb79-c832-4ff2-bd79-88e28018ceab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:03.364676 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d2beb79-c832-4ff2-bd79-88e28018ceab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:03.364676 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d2beb79-c832-4ff2-bd79-88e28018ceab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:03.364676 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d2beb79-c832-4ff2-bd79-88e28018ceab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:03.364676 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7d2beb79-c832-4ff2-bd79-88e28018ceab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:03.422508 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7ab0ea6b-a52e-4728-8617-fd14d640c401 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:03.423854 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7ab0ea6b-a52e-4728-8617-fd14d640c401 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:03.432896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ab0ea6b-a52e-4728-8617-fd14d640c401 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:03.433653 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ab0ea6b-a52e-4728-8617-fd14d640c401 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:03.435181 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ab0ea6b-a52e-4728-8617-fd14d640c401 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:03.435790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7ab0ea6b-a52e-4728-8617-fd14d640c401 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:03.555807 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7d2beb79-c832-4ff2-bd79-88e28018ceab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:03.569134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7d2beb79-c832-4ff2-bd79-88e28018ceab tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.220633 Jul 04 09:22:03.569134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 188/399] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:03 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:03.612626 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7ab0ea6b-a52e-4728-8617-fd14d640c401 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:03.621116 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bff5898b-d32b-43dd-90b7-729a8c9ad712 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:03.622423 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bff5898b-d32b-43dd-90b7-729a8c9ad712 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:03.626368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7ab0ea6b-a52e-4728-8617-fd14d640c401 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:03.628075 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7ab0ea6b-a52e-4728-8617-fd14d640c401 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:03.628450 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bff5898b-d32b-43dd-90b7-729a8c9ad712 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:03.628933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bff5898b-d32b-43dd-90b7-729a8c9ad712 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:03.629673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7ab0ea6b-a52e-4728-8617-fd14d640c401 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.216238 Jul 04 09:22:03.630014 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bff5898b-d32b-43dd-90b7-729a8c9ad712 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:03.630505 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bff5898b-d32b-43dd-90b7-729a8c9ad712 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:03.630656 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 212/400] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:03 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:03.783269 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-bff5898b-d32b-43dd-90b7-729a8c9ad712 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:03.792142 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bff5898b-d32b-43dd-90b7-729a8c9ad712 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.175647 Jul 04 09:22:03.793081 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 189/401] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:03 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:04.587874 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5055699b-80de-4eea-a8b2-f15b2d6fcc15 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:04.588596 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5055699b-80de-4eea-a8b2-f15b2d6fcc15 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:04.595900 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5055699b-80de-4eea-a8b2-f15b2d6fcc15 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:04.596356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5055699b-80de-4eea-a8b2-f15b2d6fcc15 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:04.597167 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5055699b-80de-4eea-a8b2-f15b2d6fcc15 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:04.597679 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5055699b-80de-4eea-a8b2-f15b2d6fcc15 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:04.650051 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-42ba5039-9d73-42d9-a3ed-3510c023eb1e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:04.653261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-42ba5039-9d73-42d9-a3ed-3510c023eb1e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:04.661612 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-42ba5039-9d73-42d9-a3ed-3510c023eb1e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:04.662072 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-42ba5039-9d73-42d9-a3ed-3510c023eb1e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:04.663135 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-42ba5039-9d73-42d9-a3ed-3510c023eb1e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:04.663582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-42ba5039-9d73-42d9-a3ed-3510c023eb1e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:04.792561 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5055699b-80de-4eea-a8b2-f15b2d6fcc15 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:04.801487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5055699b-80de-4eea-a8b2-f15b2d6fcc15 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.217527 Jul 04 09:22:04.802343 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 213/402] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:04 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:04.820784 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7d9d99c4-35c9-4ea4-96a8-952d9a226238 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:04.823436 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7d9d99c4-35c9-4ea4-96a8-952d9a226238 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:04.833551 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7d9d99c4-35c9-4ea4-96a8-952d9a226238 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:04.834050 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7d9d99c4-35c9-4ea4-96a8-952d9a226238 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:04.834863 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7d9d99c4-35c9-4ea4-96a8-952d9a226238 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:04.835305 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7d9d99c4-35c9-4ea4-96a8-952d9a226238 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:04.870166 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-42ba5039-9d73-42d9-a3ed-3510c023eb1e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:04.883779 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-42ba5039-9d73-42d9-a3ed-3510c023eb1e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:04.885858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-42ba5039-9d73-42d9-a3ed-3510c023eb1e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:04.894018 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-42ba5039-9d73-42d9-a3ed-3510c023eb1e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.248664 Jul 04 09:22:04.899926 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 190/403] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:04 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:04.992136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7d9d99c4-35c9-4ea4-96a8-952d9a226238 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:05.000416 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7d9d99c4-35c9-4ea4-96a8-952d9a226238 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.183926 Jul 04 09:22:05.000996 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 214/404] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:04 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:05.820585 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-956101b0-9bf7-4749-ba42-61ab19b8d66c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:05.822110 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-956101b0-9bf7-4749-ba42-61ab19b8d66c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:05.830333 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-956101b0-9bf7-4749-ba42-61ab19b8d66c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:05.830882 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-956101b0-9bf7-4749-ba42-61ab19b8d66c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:05.831960 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-956101b0-9bf7-4749-ba42-61ab19b8d66c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:05.832591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-956101b0-9bf7-4749-ba42-61ab19b8d66c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:05.920074 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d370a826-a20b-4c2b-a9ec-8316e2d7cc14 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:05.920639 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d370a826-a20b-4c2b-a9ec-8316e2d7cc14 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:05.934641 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d370a826-a20b-4c2b-a9ec-8316e2d7cc14 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:05.935337 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d370a826-a20b-4c2b-a9ec-8316e2d7cc14 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:05.936276 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d370a826-a20b-4c2b-a9ec-8316e2d7cc14 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:05.936700 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d370a826-a20b-4c2b-a9ec-8316e2d7cc14 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:06.001728 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-956101b0-9bf7-4749-ba42-61ab19b8d66c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:06.010011 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-956101b0-9bf7-4749-ba42-61ab19b8d66c tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.193708 Jul 04 09:22:06.010579 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 191/405] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:05 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:06.026551 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4b717e20-7a52-4a6a-b8fa-af086470853b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:06.027197 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4b717e20-7a52-4a6a-b8fa-af086470853b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:06.034793 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4b717e20-7a52-4a6a-b8fa-af086470853b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:06.035492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4b717e20-7a52-4a6a-b8fa-af086470853b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:06.036428 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4b717e20-7a52-4a6a-b8fa-af086470853b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:06.036865 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4b717e20-7a52-4a6a-b8fa-af086470853b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:06.157657 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d370a826-a20b-4c2b-a9ec-8316e2d7cc14 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:06.171474 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d370a826-a20b-4c2b-a9ec-8316e2d7cc14 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:06.172942 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d370a826-a20b-4c2b-a9ec-8316e2d7cc14 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:06.174153 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d370a826-a20b-4c2b-a9ec-8316e2d7cc14 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.260040 Jul 04 09:22:06.174708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 215/406] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:05 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:06.205786 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4b717e20-7a52-4a6a-b8fa-af086470853b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:06.220986 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4b717e20-7a52-4a6a-b8fa-af086470853b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.198231 Jul 04 09:22:06.227229 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 192/407] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:06 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:07.029228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c12efac5-76ec-43fe-bd19-b33d1e79bb9a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:07.029903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c12efac5-76ec-43fe-bd19-b33d1e79bb9a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:07.036419 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c12efac5-76ec-43fe-bd19-b33d1e79bb9a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:07.036881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c12efac5-76ec-43fe-bd19-b33d1e79bb9a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:07.037701 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c12efac5-76ec-43fe-bd19-b33d1e79bb9a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:07.038140 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c12efac5-76ec-43fe-bd19-b33d1e79bb9a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:07.180257 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c12efac5-76ec-43fe-bd19-b33d1e79bb9a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:07.188600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c12efac5-76ec-43fe-bd19-b33d1e79bb9a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.163520 Jul 04 09:22:07.189417 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 216/408] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:07 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:07.192384 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b106f997-31cb-4892-9b8a-899735fb78f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:07.193362 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b106f997-31cb-4892-9b8a-899735fb78f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:07.203117 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b106f997-31cb-4892-9b8a-899735fb78f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:07.203965 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b106f997-31cb-4892-9b8a-899735fb78f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:07.204871 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b106f997-31cb-4892-9b8a-899735fb78f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:07.205445 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b106f997-31cb-4892-9b8a-899735fb78f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:07.238678 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-293cf371-a6d7-41fe-b1a8-b2d5bca55f73 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:07.239217 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-293cf371-a6d7-41fe-b1a8-b2d5bca55f73 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:07.249425 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-293cf371-a6d7-41fe-b1a8-b2d5bca55f73 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:07.249872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-293cf371-a6d7-41fe-b1a8-b2d5bca55f73 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:07.251418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-293cf371-a6d7-41fe-b1a8-b2d5bca55f73 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:07.252121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-293cf371-a6d7-41fe-b1a8-b2d5bca55f73 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:07.409442 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b106f997-31cb-4892-9b8a-899735fb78f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:07.418230 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b106f997-31cb-4892-9b8a-899735fb78f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:07.420909 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b106f997-31cb-4892-9b8a-899735fb78f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:07.422404 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b106f997-31cb-4892-9b8a-899735fb78f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.234574 Jul 04 09:22:07.423159 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 193/409] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:07 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:07.453909 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-293cf371-a6d7-41fe-b1a8-b2d5bca55f73 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:07.462791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-293cf371-a6d7-41fe-b1a8-b2d5bca55f73 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.227912 Jul 04 09:22:07.463363 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 217/410] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:07 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:08.205413 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a8458a4a-39df-4b1c-aa86-3be1350a50e3 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:08.206035 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a8458a4a-39df-4b1c-aa86-3be1350a50e3 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:08.212751 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8458a4a-39df-4b1c-aa86-3be1350a50e3 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:08.213468 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8458a4a-39df-4b1c-aa86-3be1350a50e3 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:08.214457 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8458a4a-39df-4b1c-aa86-3be1350a50e3 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:08.215160 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8458a4a-39df-4b1c-aa86-3be1350a50e3 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:08.352406 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a8458a4a-39df-4b1c-aa86-3be1350a50e3 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:08.371808 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a8458a4a-39df-4b1c-aa86-3be1350a50e3 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.170122 Jul 04 09:22:08.372418 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 194/411] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:08 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:08.440580 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3237d76b-b7cd-41c7-939a-4c20e74824f0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:08.441808 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3237d76b-b7cd-41c7-939a-4c20e74824f0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:08.444423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=82 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:08.450322 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3237d76b-b7cd-41c7-939a-4c20e74824f0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:08.450781 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3237d76b-b7cd-41c7-939a-4c20e74824f0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:08.452078 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3237d76b-b7cd-41c7-939a-4c20e74824f0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:08.452523 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3237d76b-b7cd-41c7-939a-4c20e74824f0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:08.483093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b8b01d95-d7cc-47e6-9311-1a3a573c69ce tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:08.483818 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b8b01d95-d7cc-47e6-9311-1a3a573c69ce tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:08.491491 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b8b01d95-d7cc-47e6-9311-1a3a573c69ce tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:08.491941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b8b01d95-d7cc-47e6-9311-1a3a573c69ce tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:08.492714 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b8b01d95-d7cc-47e6-9311-1a3a573c69ce tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:08.493181 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b8b01d95-d7cc-47e6-9311-1a3a573c69ce tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:08.645983 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3237d76b-b7cd-41c7-939a-4c20e74824f0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:08.655711 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3237d76b-b7cd-41c7-939a-4c20e74824f0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:08.657260 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3237d76b-b7cd-41c7-939a-4c20e74824f0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:08.658643 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3237d76b-b7cd-41c7-939a-4c20e74824f0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.222941 Jul 04 09:22:08.659195 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 218/412] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:08 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:08.682223 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b8b01d95-d7cc-47e6-9311-1a3a573c69ce tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:08.690040 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b8b01d95-d7cc-47e6-9311-1a3a573c69ce tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.212451 Jul 04 09:22:08.690619 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 195/413] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:08 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:09.390902 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-345e733c-b578-423d-a9c7-e1b20812b543 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:09.391547 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-345e733c-b578-423d-a9c7-e1b20812b543 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:09.398565 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-345e733c-b578-423d-a9c7-e1b20812b543 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:09.399034 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-345e733c-b578-423d-a9c7-e1b20812b543 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:09.399859 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-345e733c-b578-423d-a9c7-e1b20812b543 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:09.400359 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-345e733c-b578-423d-a9c7-e1b20812b543 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:09.547339 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-345e733c-b578-423d-a9c7-e1b20812b543 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:09.554807 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-345e733c-b578-423d-a9c7-e1b20812b543 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.168859 Jul 04 09:22:09.556177 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 219/414] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:09 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:09.676996 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-031f6f20-7d60-417f-bfdf-f59d904f5e17 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:09.677596 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-031f6f20-7d60-417f-bfdf-f59d904f5e17 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:09.684363 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-031f6f20-7d60-417f-bfdf-f59d904f5e17 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:09.684901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-031f6f20-7d60-417f-bfdf-f59d904f5e17 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:09.687113 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-031f6f20-7d60-417f-bfdf-f59d904f5e17 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:09.687914 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-031f6f20-7d60-417f-bfdf-f59d904f5e17 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:09.708053 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8a2b38d9-b763-4885-b34c-0a3a1f7dc9f4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:09.708897 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8a2b38d9-b763-4885-b34c-0a3a1f7dc9f4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:09.715408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a2b38d9-b763-4885-b34c-0a3a1f7dc9f4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:09.716092 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a2b38d9-b763-4885-b34c-0a3a1f7dc9f4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:09.716867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a2b38d9-b763-4885-b34c-0a3a1f7dc9f4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:09.717335 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8a2b38d9-b763-4885-b34c-0a3a1f7dc9f4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:09.901272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-031f6f20-7d60-417f-bfdf-f59d904f5e17 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:09.903713 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:09.905324 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8a2b38d9-b763-4885-b34c-0a3a1f7dc9f4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:09.912668 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-031f6f20-7d60-417f-bfdf-f59d904f5e17 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:09.914212 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-031f6f20-7d60-417f-bfdf-f59d904f5e17 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:09.915386 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-031f6f20-7d60-417f-bfdf-f59d904f5e17 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.242358 Jul 04 09:22:09.921196 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 196/415] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:09 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:09.922146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8a2b38d9-b763-4885-b34c-0a3a1f7dc9f4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.218794 Jul 04 09:22:09.922801 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 220/416] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:09 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:10.572477 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-930a6409-00f3-499e-b9a7-029c3f0f46d5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:10.573113 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-930a6409-00f3-499e-b9a7-029c3f0f46d5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:10.580947 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-930a6409-00f3-499e-b9a7-029c3f0f46d5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:10.581432 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-930a6409-00f3-499e-b9a7-029c3f0f46d5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:10.582191 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-930a6409-00f3-499e-b9a7-029c3f0f46d5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:10.582623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-930a6409-00f3-499e-b9a7-029c3f0f46d5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:10.712823 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-930a6409-00f3-499e-b9a7-029c3f0f46d5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:10.720528 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-930a6409-00f3-499e-b9a7-029c3f0f46d5 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.152211 Jul 04 09:22:10.721107 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 197/417] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:10 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:10.934045 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6e5e5269-d4c7-44e2-8ffe-90d478e9d02b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:10.934606 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6e5e5269-d4c7-44e2-8ffe-90d478e9d02b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:10.939344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1825cda5-d92d-4ece-8250-287a017e2248 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:10.939995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1825cda5-d92d-4ece-8250-287a017e2248 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:10.941773 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6e5e5269-d4c7-44e2-8ffe-90d478e9d02b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:10.942225 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6e5e5269-d4c7-44e2-8ffe-90d478e9d02b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:10.943027 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6e5e5269-d4c7-44e2-8ffe-90d478e9d02b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:10.944332 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6e5e5269-d4c7-44e2-8ffe-90d478e9d02b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:10.946064 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1825cda5-d92d-4ece-8250-287a017e2248 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:10.946526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1825cda5-d92d-4ece-8250-287a017e2248 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:10.947389 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1825cda5-d92d-4ece-8250-287a017e2248 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:10.947833 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1825cda5-d92d-4ece-8250-287a017e2248 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:11.146910 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6e5e5269-d4c7-44e2-8ffe-90d478e9d02b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:11.150249 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1825cda5-d92d-4ece-8250-287a017e2248 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:11.155846 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6e5e5269-d4c7-44e2-8ffe-90d478e9d02b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:11.157390 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6e5e5269-d4c7-44e2-8ffe-90d478e9d02b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:11.158251 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1825cda5-d92d-4ece-8250-287a017e2248 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.223326 Jul 04 09:22:11.158675 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6e5e5269-d4c7-44e2-8ffe-90d478e9d02b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.228823 Jul 04 09:22:11.159047 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 198/418] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:10 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:11.159911 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 221/419] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:10 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:11.738646 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b1ef0865-0e37-4b52-9bc1-babe4354aa49 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:11.739587 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b1ef0865-0e37-4b52-9bc1-babe4354aa49 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:11.747196 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1ef0865-0e37-4b52-9bc1-babe4354aa49 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:11.747651 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1ef0865-0e37-4b52-9bc1-babe4354aa49 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:11.748501 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1ef0865-0e37-4b52-9bc1-babe4354aa49 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:11.748945 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1ef0865-0e37-4b52-9bc1-babe4354aa49 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:11.881343 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b1ef0865-0e37-4b52-9bc1-babe4354aa49 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:11.890031 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b1ef0865-0e37-4b52-9bc1-babe4354aa49 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.156926 Jul 04 09:22:11.890620 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 199/420] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:11 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:12.176310 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2a48b2e5-afd3-4e21-afb9-7896e17d8808 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:12.176515 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9bc5eb3e-23ac-483a-9efc-4e447b01cd5a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:12.177072 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2a48b2e5-afd3-4e21-afb9-7896e17d8808 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:12.177195 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9bc5eb3e-23ac-483a-9efc-4e447b01cd5a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:12.182965 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a48b2e5-afd3-4e21-afb9-7896e17d8808 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:12.183414 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a48b2e5-afd3-4e21-afb9-7896e17d8808 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:12.183601 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9bc5eb3e-23ac-483a-9efc-4e447b01cd5a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:12.184030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9bc5eb3e-23ac-483a-9efc-4e447b01cd5a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:12.184214 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a48b2e5-afd3-4e21-afb9-7896e17d8808 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:12.184608 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2a48b2e5-afd3-4e21-afb9-7896e17d8808 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:12.184917 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9bc5eb3e-23ac-483a-9efc-4e447b01cd5a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:12.186053 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9bc5eb3e-23ac-483a-9efc-4e447b01cd5a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:12.393792 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2a48b2e5-afd3-4e21-afb9-7896e17d8808 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:12.398106 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9bc5eb3e-23ac-483a-9efc-4e447b01cd5a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:12.404124 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2a48b2e5-afd3-4e21-afb9-7896e17d8808 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:12.405106 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9bc5eb3e-23ac-483a-9efc-4e447b01cd5a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.232701 Jul 04 09:22:12.405672 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 222/421] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:12 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:12.405795 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2a48b2e5-afd3-4e21-afb9-7896e17d8808 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:12.407040 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2a48b2e5-afd3-4e21-afb9-7896e17d8808 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.234672 Jul 04 09:22:12.407607 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 200/422] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:12 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:12.907477 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0e423243-92f2-4cbf-b1bf-214a3763d744 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:12.908088 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0e423243-92f2-4cbf-b1bf-214a3763d744 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:12.914108 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e423243-92f2-4cbf-b1bf-214a3763d744 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:12.914550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e423243-92f2-4cbf-b1bf-214a3763d744 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:12.915303 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e423243-92f2-4cbf-b1bf-214a3763d744 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:12.915735 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e423243-92f2-4cbf-b1bf-214a3763d744 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:13.050485 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0e423243-92f2-4cbf-b1bf-214a3763d744 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:13.057949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0e423243-92f2-4cbf-b1bf-214a3763d744 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1319 microversion: 2.1 time: 0.154881 Jul 04 09:22:13.058513 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 223/423] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:12 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:13.421969 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ec0bc98f-8e89-46d2-9eb5-c7dd67242cb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:13.422707 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ec0bc98f-8e89-46d2-9eb5-c7dd67242cb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:13.425423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9d1d39c0-0f39-46f5-8b69-0a2e9a5b1e35 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:13.426034 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9d1d39c0-0f39-46f5-8b69-0a2e9a5b1e35 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:13.429540 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ec0bc98f-8e89-46d2-9eb5-c7dd67242cb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:13.430200 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ec0bc98f-8e89-46d2-9eb5-c7dd67242cb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:13.431144 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ec0bc98f-8e89-46d2-9eb5-c7dd67242cb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:13.431747 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ec0bc98f-8e89-46d2-9eb5-c7dd67242cb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:13.433128 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d1d39c0-0f39-46f5-8b69-0a2e9a5b1e35 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:13.433528 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d1d39c0-0f39-46f5-8b69-0a2e9a5b1e35 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:13.434296 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d1d39c0-0f39-46f5-8b69-0a2e9a5b1e35 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:13.434737 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d1d39c0-0f39-46f5-8b69-0a2e9a5b1e35 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:13.635795 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ec0bc98f-8e89-46d2-9eb5-c7dd67242cb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:13.644195 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9d1d39c0-0f39-46f5-8b69-0a2e9a5b1e35 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:13.644735 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ec0bc98f-8e89-46d2-9eb5-c7dd67242cb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.227063 Jul 04 09:22:13.645814 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 201/424] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:13 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:13.656528 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9d1d39c0-0f39-46f5-8b69-0a2e9a5b1e35 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:13.658195 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9d1d39c0-0f39-46f5-8b69-0a2e9a5b1e35 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:13.659363 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9d1d39c0-0f39-46f5-8b69-0a2e9a5b1e35 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.237831 Jul 04 09:22:13.659998 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 224/425] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:13 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:14.074696 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-15624543-c673-4907-aac4-339091b50fcb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:14.075308 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-15624543-c673-4907-aac4-339091b50fcb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:14.081916 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15624543-c673-4907-aac4-339091b50fcb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:14.082369 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15624543-c673-4907-aac4-339091b50fcb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:14.083163 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15624543-c673-4907-aac4-339091b50fcb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:14.083598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15624543-c673-4907-aac4-339091b50fcb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:14.226385 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-15624543-c673-4907-aac4-339091b50fcb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:14.234538 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-15624543-c673-4907-aac4-339091b50fcb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1507 microversion: 2.1 time: 0.163617 Jul 04 09:22:14.235124 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 202/426] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:14 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:14.251189 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8df72ae5-758a-4d09-ac93-440f7c38afbb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e576b2f-9377-49d5-aac0-05f7cd8d91a1", "device": "/dev/sdb"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:14.253059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8df72ae5-758a-4d09-ac93-440f7c38afbb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:14.259343 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8df72ae5-758a-4d09-ac93-440f7c38afbb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:14.259877 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8df72ae5-758a-4d09-ac93-440f7c38afbb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:14.260656 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8df72ae5-758a-4d09-ac93-440f7c38afbb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:14.261180 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8df72ae5-758a-4d09-ac93-440f7c38afbb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:14.277676 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:14.662096 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-73c22277-5a50-452c-bd5a-120bfafa4a28 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:14.662711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-73c22277-5a50-452c-bd5a-120bfafa4a28 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:14.669104 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73c22277-5a50-452c-bd5a-120bfafa4a28 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:14.669559 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73c22277-5a50-452c-bd5a-120bfafa4a28 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:14.671867 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73c22277-5a50-452c-bd5a-120bfafa4a28 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:14.671867 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-73c22277-5a50-452c-bd5a-120bfafa4a28 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:14.801899 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-73c22277-5a50-452c-bd5a-120bfafa4a28 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:14.809301 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-73c22277-5a50-452c-bd5a-120bfafa4a28 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.151043 Jul 04 09:22:14.809870 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 203/427] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:14 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:14.814557 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-513c1d5a-3035-4116-9a32-ab6bababa8c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:14.815162 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-513c1d5a-3035-4116-9a32-ab6bababa8c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:14.820970 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-513c1d5a-3035-4116-9a32-ab6bababa8c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:14.821464 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-513c1d5a-3035-4116-9a32-ab6bababa8c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:14.822273 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-513c1d5a-3035-4116-9a32-ab6bababa8c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:14.822709 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-513c1d5a-3035-4116-9a32-ab6bababa8c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:14.953671 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-513c1d5a-3035-4116-9a32-ab6bababa8c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:14.962285 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-513c1d5a-3035-4116-9a32-ab6bababa8c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:14.963782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-513c1d5a-3035-4116-9a32-ab6bababa8c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:14.964927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-513c1d5a-3035-4116-9a32-ab6bababa8c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.153892 Jul 04 09:22:14.965784 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 204/428] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:14 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:15.827265 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-03f7806d-634e-4271-99fd-12ad6f8778bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:15.827940 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-03f7806d-634e-4271-99fd-12ad6f8778bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:15.834352 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-03f7806d-634e-4271-99fd-12ad6f8778bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:15.834801 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-03f7806d-634e-4271-99fd-12ad6f8778bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:15.835556 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-03f7806d-634e-4271-99fd-12ad6f8778bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:15.835987 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-03f7806d-634e-4271-99fd-12ad6f8778bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:15.963524 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-03f7806d-634e-4271-99fd-12ad6f8778bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:15.971948 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-03f7806d-634e-4271-99fd-12ad6f8778bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.149022 Jul 04 09:22:15.972511 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 205/429] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:15 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:15.983891 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6d3e9c1c-2afc-4f77-985e-2838665ed11c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:15.984493 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6d3e9c1c-2afc-4f77-985e-2838665ed11c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:15.990380 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d3e9c1c-2afc-4f77-985e-2838665ed11c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:15.990839 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d3e9c1c-2afc-4f77-985e-2838665ed11c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:15.991602 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d3e9c1c-2afc-4f77-985e-2838665ed11c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:15.992044 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6d3e9c1c-2afc-4f77-985e-2838665ed11c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:16.129476 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6d3e9c1c-2afc-4f77-985e-2838665ed11c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:16.137896 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6d3e9c1c-2afc-4f77-985e-2838665ed11c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:16.139404 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6d3e9c1c-2afc-4f77-985e-2838665ed11c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:16.140545 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6d3e9c1c-2afc-4f77-985e-2838665ed11c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.160929 Jul 04 09:22:16.141124 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 206/430] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:15 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:16.988290 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8ac57891-70e1-4af7-ad09-2e476a73fa32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:16.988937 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8ac57891-70e1-4af7-ad09-2e476a73fa32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:16.995450 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ac57891-70e1-4af7-ad09-2e476a73fa32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:16.995946 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ac57891-70e1-4af7-ad09-2e476a73fa32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:16.996704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ac57891-70e1-4af7-ad09-2e476a73fa32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:16.997177 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8ac57891-70e1-4af7-ad09-2e476a73fa32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:17.151166 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8ac57891-70e1-4af7-ad09-2e476a73fa32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:17.160197 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8ac57891-70e1-4af7-ad09-2e476a73fa32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.175619 Jul 04 09:22:17.160776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 207/431] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:16 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:17.165334 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-344f68e8-af85-47e0-a3bd-9fd3f3a3344f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:17.165970 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-344f68e8-af85-47e0-a3bd-9fd3f3a3344f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:17.172828 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-344f68e8-af85-47e0-a3bd-9fd3f3a3344f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:17.173397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-344f68e8-af85-47e0-a3bd-9fd3f3a3344f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:17.174295 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-344f68e8-af85-47e0-a3bd-9fd3f3a3344f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:17.174874 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-344f68e8-af85-47e0-a3bd-9fd3f3a3344f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:17.304173 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-344f68e8-af85-47e0-a3bd-9fd3f3a3344f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:17.313510 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-344f68e8-af85-47e0-a3bd-9fd3f3a3344f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:17.315012 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-344f68e8-af85-47e0-a3bd-9fd3f3a3344f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:17.316157 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-344f68e8-af85-47e0-a3bd-9fd3f3a3344f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.154426 Jul 04 09:22:17.316717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 208/432] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:17 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:17.479205 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8df72ae5-758a-4d09-ac93-440f7c38afbb tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "POST /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.232140 Jul 04 09:22:17.479832 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 225/433] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:22:14 2022] POST /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99/os-volume_attachments => generated 194 bytes in 3234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:18.177044 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-76f5eb45-b226-4c71-8928-527e67a5d0e1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:18.177675 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-76f5eb45-b226-4c71-8928-527e67a5d0e1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:18.184109 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76f5eb45-b226-4c71-8928-527e67a5d0e1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:18.184554 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76f5eb45-b226-4c71-8928-527e67a5d0e1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:18.186036 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76f5eb45-b226-4c71-8928-527e67a5d0e1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:18.186662 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-76f5eb45-b226-4c71-8928-527e67a5d0e1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:18.315982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-76f5eb45-b226-4c71-8928-527e67a5d0e1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:18.323586 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-76f5eb45-b226-4c71-8928-527e67a5d0e1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.150410 Jul 04 09:22:18.324155 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 209/434] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:18 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:18.334417 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-32d219af-4031-479b-b2e0-8f113f64fa63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:18.335117 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-32d219af-4031-479b-b2e0-8f113f64fa63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:18.342674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-32d219af-4031-479b-b2e0-8f113f64fa63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:18.343115 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-32d219af-4031-479b-b2e0-8f113f64fa63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:18.343877 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-32d219af-4031-479b-b2e0-8f113f64fa63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:18.344311 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-32d219af-4031-479b-b2e0-8f113f64fa63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:18.491416 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-32d219af-4031-479b-b2e0-8f113f64fa63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:18.500439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-32d219af-4031-479b-b2e0-8f113f64fa63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:18.502550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-32d219af-4031-479b-b2e0-8f113f64fa63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:18.503729 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-32d219af-4031-479b-b2e0-8f113f64fa63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.173547 Jul 04 09:22:18.504278 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 226/435] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:18 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:19.340392 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-34a8c6eb-d94f-47f7-abdf-ff2d79633f78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:19.341001 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-34a8c6eb-d94f-47f7-abdf-ff2d79633f78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:19.348086 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34a8c6eb-d94f-47f7-abdf-ff2d79633f78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:19.348531 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34a8c6eb-d94f-47f7-abdf-ff2d79633f78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:19.349312 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34a8c6eb-d94f-47f7-abdf-ff2d79633f78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:19.349744 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-34a8c6eb-d94f-47f7-abdf-ff2d79633f78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:19.481351 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-34a8c6eb-d94f-47f7-abdf-ff2d79633f78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:19.489405 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-34a8c6eb-d94f-47f7-abdf-ff2d79633f78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.153059 Jul 04 09:22:19.489980 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 210/436] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:19 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:19.522151 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-20b79703-c6e7-4643-b2f7-5cb426fa5878 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:19.523387 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-20b79703-c6e7-4643-b2f7-5cb426fa5878 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:19.530566 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-20b79703-c6e7-4643-b2f7-5cb426fa5878 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:19.531103 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-20b79703-c6e7-4643-b2f7-5cb426fa5878 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:19.531992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-20b79703-c6e7-4643-b2f7-5cb426fa5878 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:19.532510 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-20b79703-c6e7-4643-b2f7-5cb426fa5878 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:19.682352 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-20b79703-c6e7-4643-b2f7-5cb426fa5878 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:19.692161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-20b79703-c6e7-4643-b2f7-5cb426fa5878 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:19.693762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-20b79703-c6e7-4643-b2f7-5cb426fa5878 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:19.694920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-20b79703-c6e7-4643-b2f7-5cb426fa5878 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.176844 Jul 04 09:22:19.695828 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 227/437] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:19 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:20.507010 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-24f97fcc-1985-4b48-b71a-117bccb6e9c4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:20.507629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-24f97fcc-1985-4b48-b71a-117bccb6e9c4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:20.514490 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-24f97fcc-1985-4b48-b71a-117bccb6e9c4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:20.514946 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-24f97fcc-1985-4b48-b71a-117bccb6e9c4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:20.515716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-24f97fcc-1985-4b48-b71a-117bccb6e9c4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:20.516151 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-24f97fcc-1985-4b48-b71a-117bccb6e9c4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:20.643391 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-24f97fcc-1985-4b48-b71a-117bccb6e9c4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:20.650901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-24f97fcc-1985-4b48-b71a-117bccb6e9c4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.147751 Jul 04 09:22:20.651459 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 211/438] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:20 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:20.712674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f1c960f7-2682-4d5f-ba88-1d7434bf52f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:20.713408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f1c960f7-2682-4d5f-ba88-1d7434bf52f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:20.720926 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f1c960f7-2682-4d5f-ba88-1d7434bf52f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:20.721419 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f1c960f7-2682-4d5f-ba88-1d7434bf52f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:20.722192 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f1c960f7-2682-4d5f-ba88-1d7434bf52f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:20.722635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f1c960f7-2682-4d5f-ba88-1d7434bf52f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:20.853922 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f1c960f7-2682-4d5f-ba88-1d7434bf52f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:20.862833 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f1c960f7-2682-4d5f-ba88-1d7434bf52f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:20.864436 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f1c960f7-2682-4d5f-ba88-1d7434bf52f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:20.865734 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f1c960f7-2682-4d5f-ba88-1d7434bf52f1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.156874 Jul 04 09:22:20.866311 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 228/439] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:20 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:21.015412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ae02c3ad-7547-4606-b390-16ff2dd7135b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:21.015923 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ae02c3ad-7547-4606-b390-16ff2dd7135b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:21.021895 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae02c3ad-7547-4606-b390-16ff2dd7135b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.022353 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae02c3ad-7547-4606-b390-16ff2dd7135b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.023134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae02c3ad-7547-4606-b390-16ff2dd7135b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.023576 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ae02c3ad-7547-4606-b390-16ff2dd7135b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.047751 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ae02c3ad-7547-4606-b390-16ff2dd7135b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e/ips" status: 200 len: 148 microversion: 2.1 time: 0.037670 Jul 04 09:22:21.048441 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 212/440] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 4 09:22:21 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:21.058756 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9f633ceb-27c3-4e1e-9b48-46adc1d39a6b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a16d928d-da6f-4ed0-8413-0ea907bc4c19"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:21.059955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9f633ceb-27c3-4e1e-9b48-46adc1d39a6b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:21.067042 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f633ceb-27c3-4e1e-9b48-46adc1d39a6b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.067492 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f633ceb-27c3-4e1e-9b48-46adc1d39a6b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.068256 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f633ceb-27c3-4e1e-9b48-46adc1d39a6b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.068693 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f633ceb-27c3-4e1e-9b48-46adc1d39a6b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.149429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-9f633ceb-27c3-4e1e-9b48-46adc1d39a6b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Invalid volume: volume a16d928d-da6f-4ed0-8413-0ea907bc4c19 is already attached to instances: 1df7890f-b2e1-476d-a951-8ad28d7ff91b Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9f633ceb-27c3-4e1e-9b48-46adc1d39a6b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: POST /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e/os-volume_attachments HTTP/1.1 Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 74 Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:22:21.151187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {"volumeAttachment": {"volumeId": "a16d928d-da6f-4ed0-8413-0ea907bc4c19"}} Jul 04 09:22:21.152710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Invalid volume: volume a16d928d-da6f-4ed0-8413-0ea907bc4c19 is already attached to instances: 1df7890f-b2e1-476d-a951-8ad28d7ff91b Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'server_id': '5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e', 'body': {'volumeAttachment': {'volumeId': 'a16d928d-da6f-4ed0-8413-0ea907bc4c19'}}} Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a16d928d-da6f-4ed0-8413-0ea907bc4c19 is already attached to instances: 1df7890f-b2e1-476d-a951-8ad28d7ff91b Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:22:21.153627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a16d928d-da6f-4ed0-8413-0ea907bc4c19 is already attached to instances: 1df7890f-b2e1-476d-a951-8ad28d7ff91b Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:21.155018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:22:21.156501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:22:21.156501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:22:21.156501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:22:21.156501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a16d928d-da6f-4ed0-8413-0ea907bc4c19 is already attached to instances: 1df7890f-b2e1-476d-a951-8ad28d7ff91b Jul 04 09:22:21.156501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:22:21.156501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9f633ceb-27c3-4e1e-9b48-46adc1d39a6b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 400 to user: Invalid volume: volume a16d928d-da6f-4ed0-8413-0ea907bc4c19 is already attached to instances: 1df7890f-b2e1-476d-a951-8ad28d7ff91b {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:22:21.156501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9f633ceb-27c3-4e1e-9b48-46adc1d39a6b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097845 Jul 04 09:22:21.156501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 229/441] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:22:21 2022] POST /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:22:21.161841 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d4066efc-17b4-4f39-9cd1-0b97d6a968d8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:21.162346 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d4066efc-17b4-4f39-9cd1-0b97d6a968d8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:21.169082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4066efc-17b4-4f39-9cd1-0b97d6a968d8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.170358 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4066efc-17b4-4f39-9cd1-0b97d6a968d8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.171182 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4066efc-17b4-4f39-9cd1-0b97d6a968d8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.171631 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d4066efc-17b4-4f39-9cd1-0b97d6a968d8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.198218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d4066efc-17b4-4f39-9cd1-0b97d6a968d8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:22:21.200902 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:21.281570 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d4066efc-17b4-4f39-9cd1-0b97d6a968d8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 204 len: 0 microversion: 2.1 time: 0.123071 Jul 04 09:22:21.282269 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 213/442] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:22:21 2022] DELETE /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 09:22:21.290580 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-14313697-8ad8-48ec-b88b-2725a82d0883 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:21.291336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-14313697-8ad8-48ec-b88b-2725a82d0883 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:21.298651 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14313697-8ad8-48ec-b88b-2725a82d0883 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.299202 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14313697-8ad8-48ec-b88b-2725a82d0883 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.300045 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14313697-8ad8-48ec-b88b-2725a82d0883 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.300558 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-14313697-8ad8-48ec-b88b-2725a82d0883 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.433193 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-14313697-8ad8-48ec-b88b-2725a82d0883 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:21.442520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-14313697-8ad8-48ec-b88b-2725a82d0883 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1680 microversion: 2.1 time: 0.155803 Jul 04 09:22:21.452333 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 230/443] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:21 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:21.670303 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4ea260cd-1fe6-420a-b469-e15bcd72598e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:21.671702 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4ea260cd-1fe6-420a-b469-e15bcd72598e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:21.678012 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4ea260cd-1fe6-420a-b469-e15bcd72598e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.678470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4ea260cd-1fe6-420a-b469-e15bcd72598e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.679280 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4ea260cd-1fe6-420a-b469-e15bcd72598e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.679685 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4ea260cd-1fe6-420a-b469-e15bcd72598e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.692701 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-41454988-2f26-458c-a7c8-f4c8c89f92e9 req-045ecd03-2160-41fe-8942-71f22e9dd479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8dcc08-23ef-46ee-b941-55a7f1716d41", "name": "network-vif-plugged", "status": "completed", "tag": "170feb05-63b9-496e-b589-498558ed153c"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:21.702233 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-41454988-2f26-458c-a7c8-f4c8c89f92e9 req-045ecd03-2160-41fe-8942-71f22e9dd479 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.703150 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-41454988-2f26-458c-a7c8-f4c8c89f92e9 req-045ecd03-2160-41fe-8942-71f22e9dd479 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.716823 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-41454988-2f26-458c-a7c8-f4c8c89f92e9 req-045ecd03-2160-41fe-8942-71f22e9dd479 service nova] Creating event network-vif-plugged:170feb05-63b9-496e-b589-498558ed153c for instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 on hv-cinder-84456 Jul 04 09:22:21.722257 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-41454988-2f26-458c-a7c8-f4c8c89f92e9 req-045ecd03-2160-41fe-8942-71f22e9dd479 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033459 Jul 04 09:22:21.723252 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 231/444] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:22:21.825292 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4ea260cd-1fe6-420a-b469-e15bcd72598e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:21.832804 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4ea260cd-1fe6-420a-b469-e15bcd72598e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.167399 Jul 04 09:22:21.833403 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 214/445] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:21 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:21.885328 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5c86afe7-b2e6-482a-bf90-6c1cc692724f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:21.886031 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5c86afe7-b2e6-482a-bf90-6c1cc692724f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:21.892688 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c86afe7-b2e6-482a-bf90-6c1cc692724f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.893188 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c86afe7-b2e6-482a-bf90-6c1cc692724f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:21.893960 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c86afe7-b2e6-482a-bf90-6c1cc692724f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:21.894402 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5c86afe7-b2e6-482a-bf90-6c1cc692724f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:22.022670 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5c86afe7-b2e6-482a-bf90-6c1cc692724f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:22.031691 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5c86afe7-b2e6-482a-bf90-6c1cc692724f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:22.033271 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5c86afe7-b2e6-482a-bf90-6c1cc692724f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:22.034435 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5c86afe7-b2e6-482a-bf90-6c1cc692724f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.153367 Jul 04 09:22:22.034989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 232/446] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:21 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:22.462265 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-98530529-02ce-42f2-a2e6-f8b44095fc7f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:22.462885 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-98530529-02ce-42f2-a2e6-f8b44095fc7f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:22.469582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98530529-02ce-42f2-a2e6-f8b44095fc7f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:22.470042 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98530529-02ce-42f2-a2e6-f8b44095fc7f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:22.470812 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98530529-02ce-42f2-a2e6-f8b44095fc7f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:22.471288 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98530529-02ce-42f2-a2e6-f8b44095fc7f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:22.598691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-98530529-02ce-42f2-a2e6-f8b44095fc7f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:22.606543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-98530529-02ce-42f2-a2e6-f8b44095fc7f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1680 microversion: 2.1 time: 0.148130 Jul 04 09:22:22.607701 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 215/447] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:22 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:22.849731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d2993a36-b321-4ffa-a3f9-ccb2590a7220 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:22.850347 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d2993a36-b321-4ffa-a3f9-ccb2590a7220 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:22.856407 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2993a36-b321-4ffa-a3f9-ccb2590a7220 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:22.856864 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2993a36-b321-4ffa-a3f9-ccb2590a7220 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:22.858397 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2993a36-b321-4ffa-a3f9-ccb2590a7220 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:22.858846 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2993a36-b321-4ffa-a3f9-ccb2590a7220 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:22.989132 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d2993a36-b321-4ffa-a3f9-ccb2590a7220 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:22.996708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d2993a36-b321-4ffa-a3f9-ccb2590a7220 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.150809 Jul 04 09:22:22.997298 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 233/448] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:22 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:23.053559 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6f0c34ad-cd6e-40c6-b33b-96cea06de98c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:23.054171 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6f0c34ad-cd6e-40c6-b33b-96cea06de98c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:23.060738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f0c34ad-cd6e-40c6-b33b-96cea06de98c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:23.061217 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f0c34ad-cd6e-40c6-b33b-96cea06de98c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:23.061986 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f0c34ad-cd6e-40c6-b33b-96cea06de98c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:23.062427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f0c34ad-cd6e-40c6-b33b-96cea06de98c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:23.191322 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6f0c34ad-cd6e-40c6-b33b-96cea06de98c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:23.199637 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6f0c34ad-cd6e-40c6-b33b-96cea06de98c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:23.201743 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6f0c34ad-cd6e-40c6-b33b-96cea06de98c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:23.202932 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6f0c34ad-cd6e-40c6-b33b-96cea06de98c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.153278 Jul 04 09:22:23.203493 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 216/449] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:23 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:23.624346 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-641f18f4-58d1-45cb-8938-13043974079e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:23.624959 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-641f18f4-58d1-45cb-8938-13043974079e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:23.631038 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-641f18f4-58d1-45cb-8938-13043974079e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:23.631498 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-641f18f4-58d1-45cb-8938-13043974079e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:23.632260 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-641f18f4-58d1-45cb-8938-13043974079e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:23.632699 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-641f18f4-58d1-45cb-8938-13043974079e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:23.762583 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-641f18f4-58d1-45cb-8938-13043974079e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:23.770755 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-641f18f4-58d1-45cb-8938-13043974079e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1680 microversion: 2.1 time: 0.150936 Jul 04 09:22:23.771305 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 234/450] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:23 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:24.013701 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3bde9e69-f9b3-4df9-b4cd-baab469d17ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:24.014318 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3bde9e69-f9b3-4df9-b4cd-baab469d17ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:24.020455 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3bde9e69-f9b3-4df9-b4cd-baab469d17ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:24.020908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3bde9e69-f9b3-4df9-b4cd-baab469d17ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:24.021711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3bde9e69-f9b3-4df9-b4cd-baab469d17ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:24.022151 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3bde9e69-f9b3-4df9-b4cd-baab469d17ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:24.148232 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3bde9e69-f9b3-4df9-b4cd-baab469d17ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:24.155819 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3bde9e69-f9b3-4df9-b4cd-baab469d17ee tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.145938 Jul 04 09:22:24.156391 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 217/451] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:24 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:24.221830 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-12eb2f6c-12f4-4898-8d98-5973dedd9b70 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:24.222478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-12eb2f6c-12f4-4898-8d98-5973dedd9b70 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:24.228897 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12eb2f6c-12f4-4898-8d98-5973dedd9b70 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:24.229385 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12eb2f6c-12f4-4898-8d98-5973dedd9b70 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:24.230154 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12eb2f6c-12f4-4898-8d98-5973dedd9b70 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:24.230596 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12eb2f6c-12f4-4898-8d98-5973dedd9b70 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:24.359030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-12eb2f6c-12f4-4898-8d98-5973dedd9b70 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:24.367507 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-12eb2f6c-12f4-4898-8d98-5973dedd9b70 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:24.369023 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-12eb2f6c-12f4-4898-8d98-5973dedd9b70 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:24.370193 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-12eb2f6c-12f4-4898-8d98-5973dedd9b70 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.152351 Jul 04 09:22:24.370753 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 235/452] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:24 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:24.787813 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-49fbafab-fb4a-41af-9f5a-a817edbc8b46 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:24.788425 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-49fbafab-fb4a-41af-9f5a-a817edbc8b46 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:24.794577 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-49fbafab-fb4a-41af-9f5a-a817edbc8b46 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:24.795114 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-49fbafab-fb4a-41af-9f5a-a817edbc8b46 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:24.795880 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-49fbafab-fb4a-41af-9f5a-a817edbc8b46 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:24.796320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-49fbafab-fb4a-41af-9f5a-a817edbc8b46 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:24.927821 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-49fbafab-fb4a-41af-9f5a-a817edbc8b46 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:24.935930 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-49fbafab-fb4a-41af-9f5a-a817edbc8b46 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1680 microversion: 2.1 time: 0.151324 Jul 04 09:22:24.936816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 218/453] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:24 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:25.172838 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2394c829-9fa6-4d53-bb39-e7d4dc464cec tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:25.173405 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2394c829-9fa6-4d53-bb39-e7d4dc464cec tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:25.179454 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2394c829-9fa6-4d53-bb39-e7d4dc464cec tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:25.179913 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2394c829-9fa6-4d53-bb39-e7d4dc464cec tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:25.180676 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2394c829-9fa6-4d53-bb39-e7d4dc464cec tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:25.181150 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2394c829-9fa6-4d53-bb39-e7d4dc464cec tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:25.307145 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2394c829-9fa6-4d53-bb39-e7d4dc464cec tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:25.315266 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2394c829-9fa6-4d53-bb39-e7d4dc464cec tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.146415 Jul 04 09:22:25.315856 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 236/454] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:25 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:25.389348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-38b87f98-f6e0-4b1f-ad64-1996db14d376 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:25.389968 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-38b87f98-f6e0-4b1f-ad64-1996db14d376 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:25.396544 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38b87f98-f6e0-4b1f-ad64-1996db14d376 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:25.397006 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38b87f98-f6e0-4b1f-ad64-1996db14d376 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:25.397815 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38b87f98-f6e0-4b1f-ad64-1996db14d376 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:25.398264 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-38b87f98-f6e0-4b1f-ad64-1996db14d376 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:25.529635 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-38b87f98-f6e0-4b1f-ad64-1996db14d376 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:25.538252 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-38b87f98-f6e0-4b1f-ad64-1996db14d376 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:25.539754 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-38b87f98-f6e0-4b1f-ad64-1996db14d376 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:25.540901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-38b87f98-f6e0-4b1f-ad64-1996db14d376 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.156713 Jul 04 09:22:25.541483 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 219/455] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:25 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:25.954018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-238210b6-9ccd-46bc-be1e-eae4f78d301a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:25.954628 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-238210b6-9ccd-46bc-be1e-eae4f78d301a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:25.960832 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-238210b6-9ccd-46bc-be1e-eae4f78d301a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:25.961324 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-238210b6-9ccd-46bc-be1e-eae4f78d301a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:25.962100 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-238210b6-9ccd-46bc-be1e-eae4f78d301a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:25.962540 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-238210b6-9ccd-46bc-be1e-eae4f78d301a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:26.095980 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-238210b6-9ccd-46bc-be1e-eae4f78d301a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:26.103306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-238210b6-9ccd-46bc-be1e-eae4f78d301a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1680 microversion: 2.1 time: 0.153908 Jul 04 09:22:26.103863 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 237/456] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:25 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:26.332222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4a2eab6f-6a8b-4856-99a0-73a81dcede34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:26.332731 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4a2eab6f-6a8b-4856-99a0-73a81dcede34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:26.338791 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4a2eab6f-6a8b-4856-99a0-73a81dcede34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:26.339241 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4a2eab6f-6a8b-4856-99a0-73a81dcede34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:26.339998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4a2eab6f-6a8b-4856-99a0-73a81dcede34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:26.340694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4a2eab6f-6a8b-4856-99a0-73a81dcede34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:26.476797 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4a2eab6f-6a8b-4856-99a0-73a81dcede34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:26.484722 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4a2eab6f-6a8b-4856-99a0-73a81dcede34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.156330 Jul 04 09:22:26.485321 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 220/457] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:26 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:26.559014 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ee163f33-25b1-41e0-b03a-34861db75083 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:26.559634 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ee163f33-25b1-41e0-b03a-34861db75083 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:26.566872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ee163f33-25b1-41e0-b03a-34861db75083 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:26.567308 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ee163f33-25b1-41e0-b03a-34861db75083 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:26.568074 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ee163f33-25b1-41e0-b03a-34861db75083 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:26.568517 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ee163f33-25b1-41e0-b03a-34861db75083 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:26.697183 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ee163f33-25b1-41e0-b03a-34861db75083 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:26.706389 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ee163f33-25b1-41e0-b03a-34861db75083 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:26.707913 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ee163f33-25b1-41e0-b03a-34861db75083 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:26.709119 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ee163f33-25b1-41e0-b03a-34861db75083 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.153915 Jul 04 09:22:26.709686 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 238/458] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:26 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:27.120369 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8b616411-aebe-460d-b5c8-712960d7fb05 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:27.121104 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8b616411-aebe-460d-b5c8-712960d7fb05 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:27.128011 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b616411-aebe-460d-b5c8-712960d7fb05 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:27.128471 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b616411-aebe-460d-b5c8-712960d7fb05 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:27.129346 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b616411-aebe-460d-b5c8-712960d7fb05 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:27.130017 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8b616411-aebe-460d-b5c8-712960d7fb05 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:27.260966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8b616411-aebe-460d-b5c8-712960d7fb05 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:27.268559 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8b616411-aebe-460d-b5c8-712960d7fb05 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1680 microversion: 2.1 time: 0.152120 Jul 04 09:22:27.269150 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 221/459] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:27 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:27.502492 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b61384a2-d9b4-4bcf-9a10-e6e2925516a5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:27.503013 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b61384a2-d9b4-4bcf-9a10-e6e2925516a5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:27.509054 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b61384a2-d9b4-4bcf-9a10-e6e2925516a5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:27.509504 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b61384a2-d9b4-4bcf-9a10-e6e2925516a5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:27.510258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b61384a2-d9b4-4bcf-9a10-e6e2925516a5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:27.510689 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b61384a2-d9b4-4bcf-9a10-e6e2925516a5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:27.640780 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b61384a2-d9b4-4bcf-9a10-e6e2925516a5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:27.648416 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b61384a2-d9b4-4bcf-9a10-e6e2925516a5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.150345 Jul 04 09:22:27.649245 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 239/460] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:27 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:27.727657 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e4cd522f-5120-4f45-858f-087eb3b5afc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:27.728298 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e4cd522f-5120-4f45-858f-087eb3b5afc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:27.735374 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e4cd522f-5120-4f45-858f-087eb3b5afc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:27.735825 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e4cd522f-5120-4f45-858f-087eb3b5afc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:27.736582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e4cd522f-5120-4f45-858f-087eb3b5afc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:27.737013 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e4cd522f-5120-4f45-858f-087eb3b5afc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:27.867681 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e4cd522f-5120-4f45-858f-087eb3b5afc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:27.876131 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e4cd522f-5120-4f45-858f-087eb3b5afc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:27.877677 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e4cd522f-5120-4f45-858f-087eb3b5afc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:27.878830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e4cd522f-5120-4f45-858f-087eb3b5afc8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.155190 Jul 04 09:22:27.879393 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 222/461] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:27 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:28.286091 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8e0004db-c8e3-420d-b66a-aa8cf37293a4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:28.286698 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8e0004db-c8e3-420d-b66a-aa8cf37293a4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:28.292647 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e0004db-c8e3-420d-b66a-aa8cf37293a4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:28.293127 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e0004db-c8e3-420d-b66a-aa8cf37293a4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:28.293949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e0004db-c8e3-420d-b66a-aa8cf37293a4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:28.294618 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e0004db-c8e3-420d-b66a-aa8cf37293a4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:28.451155 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8e0004db-c8e3-420d-b66a-aa8cf37293a4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:28.458890 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8e0004db-c8e3-420d-b66a-aa8cf37293a4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1680 microversion: 2.1 time: 0.176816 Jul 04 09:22:28.459453 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 240/462] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:28 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:28.667006 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f029870a-9761-48b6-860d-f15a6eb67a9d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:28.667846 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f029870a-9761-48b6-860d-f15a6eb67a9d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:28.676026 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f029870a-9761-48b6-860d-f15a6eb67a9d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:28.676926 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f029870a-9761-48b6-860d-f15a6eb67a9d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:28.677731 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f029870a-9761-48b6-860d-f15a6eb67a9d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:28.678172 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f029870a-9761-48b6-860d-f15a6eb67a9d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:28.817920 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f029870a-9761-48b6-860d-f15a6eb67a9d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:28.825564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f029870a-9761-48b6-860d-f15a6eb67a9d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.162852 Jul 04 09:22:28.826855 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 223/463] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:28 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:28.897330 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-716d3338-d80b-43fd-b714-1ac9670e3be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:28.897940 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-716d3338-d80b-43fd-b714-1ac9670e3be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:28.905174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-716d3338-d80b-43fd-b714-1ac9670e3be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:28.905847 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-716d3338-d80b-43fd-b714-1ac9670e3be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:28.906658 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-716d3338-d80b-43fd-b714-1ac9670e3be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:28.907102 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-716d3338-d80b-43fd-b714-1ac9670e3be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:28.923163 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:29.040899 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-716d3338-d80b-43fd-b714-1ac9670e3be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:29.050158 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-716d3338-d80b-43fd-b714-1ac9670e3be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:29.051749 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-716d3338-d80b-43fd-b714-1ac9670e3be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:29.052942 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-716d3338-d80b-43fd-b714-1ac9670e3be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.159616 Jul 04 09:22:29.053614 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 241/464] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:28 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:29.476038 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7bb1a587-4bbb-463e-9063-a59902d4f6f4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:29.476769 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7bb1a587-4bbb-463e-9063-a59902d4f6f4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:29.483319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7bb1a587-4bbb-463e-9063-a59902d4f6f4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:29.483776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7bb1a587-4bbb-463e-9063-a59902d4f6f4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:29.484571 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7bb1a587-4bbb-463e-9063-a59902d4f6f4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:29.485033 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7bb1a587-4bbb-463e-9063-a59902d4f6f4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:29.550598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7bb1a587-4bbb-463e-9063-a59902d4f6f4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:29.558692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7bb1a587-4bbb-463e-9063-a59902d4f6f4 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1612 microversion: 2.1 time: 0.086750 Jul 04 09:22:29.564842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 224/465] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:29 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1612 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:29.589017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-947baf72-4444-4202-b589-262642c1cc7a req-4937a89b-da28-42f0-a04b-8dd32a0001fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e", "name": "network-vif-deleted", "tag": "4342135f-47ac-4111-90c5-e5c2887b2f02"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:29.597944 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-947baf72-4444-4202-b589-262642c1cc7a req-4937a89b-da28-42f0-a04b-8dd32a0001fd service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:29.598476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-947baf72-4444-4202-b589-262642c1cc7a req-4937a89b-da28-42f0-a04b-8dd32a0001fd service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:29.610078 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-947baf72-4444-4202-b589-262642c1cc7a req-4937a89b-da28-42f0-a04b-8dd32a0001fd service nova] Creating event network-vif-deleted:4342135f-47ac-4111-90c5-e5c2887b2f02 for instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e on hv-cinder-84456 Jul 04 09:22:29.615382 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-947baf72-4444-4202-b589-262642c1cc7a req-4937a89b-da28-42f0-a04b-8dd32a0001fd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030561 Jul 04 09:22:29.616100 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 242/466] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:29.844822 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-14e3a1e5-7c91-4f8c-b418-584276730fa1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:29.845391 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-14e3a1e5-7c91-4f8c-b418-584276730fa1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:29.852014 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-14e3a1e5-7c91-4f8c-b418-584276730fa1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:29.852456 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-14e3a1e5-7c91-4f8c-b418-584276730fa1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:29.853257 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-14e3a1e5-7c91-4f8c-b418-584276730fa1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:29.853695 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-14e3a1e5-7c91-4f8c-b418-584276730fa1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:29.999771 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-14e3a1e5-7c91-4f8c-b418-584276730fa1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:30.007499 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-14e3a1e5-7c91-4f8c-b418-584276730fa1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.167830 Jul 04 09:22:30.008079 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 225/467] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:29 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:30.070596 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-65636e90-df7b-4335-b54f-de3ea7e316e4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:30.071333 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-65636e90-df7b-4335-b54f-de3ea7e316e4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:30.078888 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65636e90-df7b-4335-b54f-de3ea7e316e4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:30.079343 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65636e90-df7b-4335-b54f-de3ea7e316e4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:30.080116 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65636e90-df7b-4335-b54f-de3ea7e316e4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:30.080556 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65636e90-df7b-4335-b54f-de3ea7e316e4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:30.216225 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-65636e90-df7b-4335-b54f-de3ea7e316e4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:30.224600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-65636e90-df7b-4335-b54f-de3ea7e316e4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:30.226167 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-65636e90-df7b-4335-b54f-de3ea7e316e4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:30.227339 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-65636e90-df7b-4335-b54f-de3ea7e316e4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.161004 Jul 04 09:22:30.228428 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 243/468] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:30 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:30.575776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-657c9323-b4af-46da-bf9e-94fe0a5e8d99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:30.576740 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-657c9323-b4af-46da-bf9e-94fe0a5e8d99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:30.584631 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-657c9323-b4af-46da-bf9e-94fe0a5e8d99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:30.585220 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-657c9323-b4af-46da-bf9e-94fe0a5e8d99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:30.586260 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-657c9323-b4af-46da-bf9e-94fe0a5e8d99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:30.586780 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-657c9323-b4af-46da-bf9e-94fe0a5e8d99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:30.660310 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-657c9323-b4af-46da-bf9e-94fe0a5e8d99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:30.668108 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-657c9323-b4af-46da-bf9e-94fe0a5e8d99 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1326 microversion: 2.1 time: 0.096205 Jul 04 09:22:30.668707 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 226/469] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:30 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:31.023838 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-04d50b16-f57f-4483-99c0-11ada7546121 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:31.024511 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-04d50b16-f57f-4483-99c0-11ada7546121 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:31.030938 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-04d50b16-f57f-4483-99c0-11ada7546121 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:31.031395 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-04d50b16-f57f-4483-99c0-11ada7546121 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:31.032194 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-04d50b16-f57f-4483-99c0-11ada7546121 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:31.032635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-04d50b16-f57f-4483-99c0-11ada7546121 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:31.163022 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-04d50b16-f57f-4483-99c0-11ada7546121 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:31.171868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-04d50b16-f57f-4483-99c0-11ada7546121 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.152043 Jul 04 09:22:31.172674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 244/470] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:31 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:31.245938 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8871626e-b84b-4d10-b763-7ea1eecc8672 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:31.246559 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8871626e-b84b-4d10-b763-7ea1eecc8672 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:31.249633 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:31.255162 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8871626e-b84b-4d10-b763-7ea1eecc8672 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:31.255623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8871626e-b84b-4d10-b763-7ea1eecc8672 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:31.256395 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8871626e-b84b-4d10-b763-7ea1eecc8672 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:31.256839 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8871626e-b84b-4d10-b763-7ea1eecc8672 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:31.409884 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8871626e-b84b-4d10-b763-7ea1eecc8672 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:31.418860 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8871626e-b84b-4d10-b763-7ea1eecc8672 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:31.421178 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8871626e-b84b-4d10-b763-7ea1eecc8672 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:31.422494 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8871626e-b84b-4d10-b763-7ea1eecc8672 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.180486 Jul 04 09:22:31.423062 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 227/471] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:31 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:31.686522 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ae028f83-df7c-43c8-88d3-1f1b0d468f7a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:31.687073 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ae028f83-df7c-43c8-88d3-1f1b0d468f7a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:31.693356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae028f83-df7c-43c8-88d3-1f1b0d468f7a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:31.693764 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae028f83-df7c-43c8-88d3-1f1b0d468f7a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:31.694547 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae028f83-df7c-43c8-88d3-1f1b0d468f7a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:31.695018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ae028f83-df7c-43c8-88d3-1f1b0d468f7a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:31.760998 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ae028f83-df7c-43c8-88d3-1f1b0d468f7a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:31.768659 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ae028f83-df7c-43c8-88d3-1f1b0d468f7a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1326 microversion: 2.1 time: 0.086799 Jul 04 09:22:31.769260 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 245/472] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:31 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:32.189365 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-65fde5f5-5441-4956-905b-ceefc75bf63b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:32.189975 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-65fde5f5-5441-4956-905b-ceefc75bf63b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:32.196024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-65fde5f5-5441-4956-905b-ceefc75bf63b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:32.196475 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-65fde5f5-5441-4956-905b-ceefc75bf63b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:32.197255 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-65fde5f5-5441-4956-905b-ceefc75bf63b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:32.197713 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-65fde5f5-5441-4956-905b-ceefc75bf63b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:32.328707 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-65fde5f5-5441-4956-905b-ceefc75bf63b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:32.330958 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:32.337778 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-65fde5f5-5441-4956-905b-ceefc75bf63b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.152717 Jul 04 09:22:32.338334 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 228/473] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:32 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:32.440507 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-34437df0-b53f-4010-a3c4-8fb964453225 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:32.441501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-34437df0-b53f-4010-a3c4-8fb964453225 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:32.451496 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34437df0-b53f-4010-a3c4-8fb964453225 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:32.452170 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34437df0-b53f-4010-a3c4-8fb964453225 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:32.453356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34437df0-b53f-4010-a3c4-8fb964453225 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:32.454021 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-34437df0-b53f-4010-a3c4-8fb964453225 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:32.587071 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-34437df0-b53f-4010-a3c4-8fb964453225 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:32.596109 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-34437df0-b53f-4010-a3c4-8fb964453225 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:32.597669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-34437df0-b53f-4010-a3c4-8fb964453225 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:32.598831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-34437df0-b53f-4010-a3c4-8fb964453225 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.162589 Jul 04 09:22:32.599380 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 246/474] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:32 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:32.785609 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-df200743-6e7a-4b65-8072-b66d21662a27 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:32.786147 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-df200743-6e7a-4b65-8072-b66d21662a27 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:32.793329 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-df200743-6e7a-4b65-8072-b66d21662a27 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:32.793784 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-df200743-6e7a-4b65-8072-b66d21662a27 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:32.794584 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-df200743-6e7a-4b65-8072-b66d21662a27 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:32.794998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-df200743-6e7a-4b65-8072-b66d21662a27 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.032815 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-df200743-6e7a-4b65-8072-b66d21662a27 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:33.040847 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-df200743-6e7a-4b65-8072-b66d21662a27 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1326 microversion: 2.1 time: 0.259482 Jul 04 09:22:33.041396 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 229/475] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:32 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1326 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:33.356124 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-635ec9b0-c432-427a-a2b7-7e9491876a03 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:33.356652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-635ec9b0-c432-427a-a2b7-7e9491876a03 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:33.363379 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-635ec9b0-c432-427a-a2b7-7e9491876a03 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:33.363831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-635ec9b0-c432-427a-a2b7-7e9491876a03 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.364597 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-635ec9b0-c432-427a-a2b7-7e9491876a03 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:33.365061 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-635ec9b0-c432-427a-a2b7-7e9491876a03 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.496460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-635ec9b0-c432-427a-a2b7-7e9491876a03 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:33.504371 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-635ec9b0-c432-427a-a2b7-7e9491876a03 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1502 microversion: 2.1 time: 0.152145 Jul 04 09:22:33.505063 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 247/476] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:33 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:33.521354 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e6fab268-4721-4e80-b343-46bed6b14ee4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e325b1c2-6ef6-4f8f-bab9-dea269b6d9f3"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:33.522482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e6fab268-4721-4e80-b343-46bed6b14ee4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:33.530449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e6fab268-4721-4e80-b343-46bed6b14ee4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:33.531256 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e6fab268-4721-4e80-b343-46bed6b14ee4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.532098 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e6fab268-4721-4e80-b343-46bed6b14ee4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:33.532553 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e6fab268-4721-4e80-b343-46bed6b14ee4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.558869 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-e6fab268-4721-4e80-b343-46bed6b14ee4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] HTTP exception thrown: Cannot 'attach_volume' instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce while it is in vm_state rescued Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e6fab268-4721-4e80-b343-46bed6b14ee4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Request method failure captured: Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: POST /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce/os-volume_attachments HTTP/1.1 Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 74 Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrDhJYSHwF3c__Nm79ScElVeUrXw69YhZNVmCicWRkTgUemaIH6UCHrTozU63At60joHPj-AnQrcYts2Iq0IA300fd3mzUxkEJgxvJPXN8qcGqHH5u7Ysi8XWtim28KiG_KJzF-pFl1_km8X6MSzoELVi4rQJFJasNBPBAsoJBv4d6w Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 930dc66606e94d9eb82cc50a67d009fb Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:22:33.560782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_930dc66606e94d9eb82cc50a67d009fb", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 930dc66606e94d9eb82cc50a67d009fb Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-ServerRescueNegativeTestJSON-20151059-project Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 9bcf554f3d6447399e1d9cfe08b0bff7 Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-ServerRescueNegativeTestJSON-20151059-project Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {"volumeAttachment": {"volumeId": "e325b1c2-6ef6-4f8f-bab9-dea269b6d9f3"}} Jul 04 09:22:33.562446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Cannot 'attach_volume' instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce while it is in vm_state rescued Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'server_id': 'be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce', 'body': {'volumeAttachment': {'volumeId': 'e325b1c2-6ef6-4f8f-bab9-dea269b6d9f3'}}} Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:22:33.563381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce while it is in vm_state rescued Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:22:33.564837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:22:33.566202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:22:33.566202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:22:33.566202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce while it is in vm_state rescued Jul 04 09:22:33.566202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:33.566202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e6fab268-4721-4e80-b343-46bed6b14ee4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Returning 409 to user: Cannot 'attach_volume' instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce while it is in vm_state rescued {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:22:33.566202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e6fab268-4721-4e80-b343-46bed6b14ee4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045083 Jul 04 09:22:33.566202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 230/477] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:22:33 2022] POST /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 04 09:22:33.572230 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a64d2ca0-b139-4329-bb5e-166dfc017217 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:33.572704 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a64d2ca0-b139-4329-bb5e-166dfc017217 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:33.579918 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a64d2ca0-b139-4329-bb5e-166dfc017217 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:33.580380 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a64d2ca0-b139-4329-bb5e-166dfc017217 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.581187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a64d2ca0-b139-4329-bb5e-166dfc017217 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:33.581668 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a64d2ca0-b139-4329-bb5e-166dfc017217 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.619689 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e95daf7d-4dc6-4471-8428-2e7c6f062d39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:33.620536 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e95daf7d-4dc6-4471-8428-2e7c6f062d39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:33.629883 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e95daf7d-4dc6-4471-8428-2e7c6f062d39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:33.631100 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e95daf7d-4dc6-4471-8428-2e7c6f062d39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.633862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e95daf7d-4dc6-4471-8428-2e7c6f062d39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:33.635472 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e95daf7d-4dc6-4471-8428-2e7c6f062d39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.678433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a64d2ca0-b139-4329-bb5e-166dfc017217 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce/action" status: 202 len: 0 microversion: 2.1 time: 0.109803 Jul 04 09:22:33.679747 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 248/478] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:22:33 2022] POST /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:22:33.692568 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6d8da688-7780-44df-8f88-175fe98bda32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:33.693490 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6d8da688-7780-44df-8f88-175fe98bda32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:33.700004 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6d8da688-7780-44df-8f88-175fe98bda32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:33.700461 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6d8da688-7780-44df-8f88-175fe98bda32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.701494 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6d8da688-7780-44df-8f88-175fe98bda32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:33.701944 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6d8da688-7780-44df-8f88-175fe98bda32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:33.855247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e95daf7d-4dc6-4471-8428-2e7c6f062d39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:33.866061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e95daf7d-4dc6-4471-8428-2e7c6f062d39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:33.868165 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e95daf7d-4dc6-4471-8428-2e7c6f062d39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:33.869544 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e95daf7d-4dc6-4471-8428-2e7c6f062d39 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.256314 Jul 04 09:22:33.881255 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 231/479] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:33 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:33.888527 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6d8da688-7780-44df-8f88-175fe98bda32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:33.893591 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6d8da688-7780-44df-8f88-175fe98bda32 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1510 microversion: 2.1 time: 0.208790 Jul 04 09:22:33.894242 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 249/480] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:33 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:34.058966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:34.059680 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:34.065943 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:34.066399 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:34.067170 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:34.067609 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:34.098964 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:34.099421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:34.099874 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lazy-loading 'fault' on Instance uuid 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:22:34.142002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:34.150070 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-00d45824-cf34-4352-8004-50578d59dd00 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1331 microversion: 2.1 time: 0.094954 Jul 04 09:22:34.150641 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 232/481] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:34 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:34.889012 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2ce6ea5d-6387-449c-9f39-220870dae3f6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:34.889695 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2ce6ea5d-6387-449c-9f39-220870dae3f6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:34.896324 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2ce6ea5d-6387-449c-9f39-220870dae3f6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:34.896778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2ce6ea5d-6387-449c-9f39-220870dae3f6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:34.897644 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2ce6ea5d-6387-449c-9f39-220870dae3f6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:34.898088 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2ce6ea5d-6387-449c-9f39-220870dae3f6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:34.910756 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fd78e131-233a-48a5-a3fe-92f47c2d3bdc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:34.911365 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fd78e131-233a-48a5-a3fe-92f47c2d3bdc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:34.917823 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd78e131-233a-48a5-a3fe-92f47c2d3bdc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:34.918218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd78e131-233a-48a5-a3fe-92f47c2d3bdc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:34.918974 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd78e131-233a-48a5-a3fe-92f47c2d3bdc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:34.919462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fd78e131-233a-48a5-a3fe-92f47c2d3bdc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:35.101605 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2ce6ea5d-6387-449c-9f39-220870dae3f6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:35.105735 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fd78e131-233a-48a5-a3fe-92f47c2d3bdc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:35.111395 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2ce6ea5d-6387-449c-9f39-220870dae3f6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:35.112946 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2ce6ea5d-6387-449c-9f39-220870dae3f6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:35.114148 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2ce6ea5d-6387-449c-9f39-220870dae3f6 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.229704 Jul 04 09:22:35.114373 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fd78e131-233a-48a5-a3fe-92f47c2d3bdc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1510 microversion: 2.1 time: 0.207340 Jul 04 09:22:35.114707 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 250/482] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:34 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:22:35.115067 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 233/483] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:34 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:35.170224 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:35.170772 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:35.177479 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:35.177925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:35.178684 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:35.179118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:35.209807 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:35.210248 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:35.210689 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lazy-loading 'fault' on Instance uuid 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:22:35.252493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:35.259650 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e89c6077-32b1-4fb5-93b6-fa62d6f954f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1331 microversion: 2.1 time: 0.094610 Jul 04 09:22:35.260200 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 251/484] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:35 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:36.131733 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-faff0634-c288-4891-b774-c8ff8b6b0b31 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:36.132362 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-44080cb5-a8da-4441-9b27-2edf23762d6b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:36.132808 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-faff0634-c288-4891-b774-c8ff8b6b0b31 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:36.132971 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-44080cb5-a8da-4441-9b27-2edf23762d6b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:36.139629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-faff0634-c288-4891-b774-c8ff8b6b0b31 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:36.139931 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-44080cb5-a8da-4441-9b27-2edf23762d6b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:36.140085 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-faff0634-c288-4891-b774-c8ff8b6b0b31 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:36.140386 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-44080cb5-a8da-4441-9b27-2edf23762d6b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:36.140851 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-faff0634-c288-4891-b774-c8ff8b6b0b31 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:36.141177 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-44080cb5-a8da-4441-9b27-2edf23762d6b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:36.141317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-faff0634-c288-4891-b774-c8ff8b6b0b31 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:36.141617 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-44080cb5-a8da-4441-9b27-2edf23762d6b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:36.337419 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-44080cb5-a8da-4441-9b27-2edf23762d6b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:36.341000 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-faff0634-c288-4891-b774-c8ff8b6b0b31 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:36.346513 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-44080cb5-a8da-4441-9b27-2edf23762d6b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:36.348043 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-44080cb5-a8da-4441-9b27-2edf23762d6b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:36.348853 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-faff0634-c288-4891-b774-c8ff8b6b0b31 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1510 microversion: 2.1 time: 0.220965 Jul 04 09:22:36.349233 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-44080cb5-a8da-4441-9b27-2edf23762d6b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.220667 Jul 04 09:22:36.349634 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 234/485] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:36 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:36.353165 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 252/486] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:36 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:36.357834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:36.358519 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:36.364519 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:36.364973 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:36.365774 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:36.366216 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:36.398175 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:36.398631 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:36.399085 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lazy-loading 'fault' on Instance uuid 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:22:36.443612 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:36.452750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0de0afdb-5cd2-4682-822d-acad5732ab44 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1331 microversion: 2.1 time: 0.098480 Jul 04 09:22:36.453379 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 235/487] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:36 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:37.365785 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4b3de9ef-77a8-45d9-a793-abc73fa26911 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:37.366842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7c6efb17-80bd-46ee-a4a7-2f99223f434b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:37.367218 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4b3de9ef-77a8-45d9-a793-abc73fa26911 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:37.367652 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7c6efb17-80bd-46ee-a4a7-2f99223f434b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:37.374438 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b3de9ef-77a8-45d9-a793-abc73fa26911 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:37.375516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b3de9ef-77a8-45d9-a793-abc73fa26911 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:37.376949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b3de9ef-77a8-45d9-a793-abc73fa26911 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:37.378286 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b3de9ef-77a8-45d9-a793-abc73fa26911 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:37.399572 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7c6efb17-80bd-46ee-a4a7-2f99223f434b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:37.400016 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7c6efb17-80bd-46ee-a4a7-2f99223f434b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:37.400804 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7c6efb17-80bd-46ee-a4a7-2f99223f434b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:37.401274 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7c6efb17-80bd-46ee-a4a7-2f99223f434b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:37.477931 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:22:37.478352 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Mon Jul 4 09:22:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 (ip 10.222.0.71) !!! Jul 04 09:22:37.608177 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4b3de9ef-77a8-45d9-a793-abc73fa26911 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:37.612635 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7c6efb17-80bd-46ee-a4a7-2f99223f434b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:37.616698 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4b3de9ef-77a8-45d9-a793-abc73fa26911 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1510 microversion: 2.1 time: 0.254731 Jul 04 09:22:37.617786 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 253/488] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:37 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:37.622251 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7c6efb17-80bd-46ee-a4a7-2f99223f434b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:37.623488 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:37.624144 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:37.624927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7c6efb17-80bd-46ee-a4a7-2f99223f434b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:37.626386 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7c6efb17-80bd-46ee-a4a7-2f99223f434b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1809 microversion: 2.20 time: 0.263915 Jul 04 09:22:37.627465 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 236/489] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:37 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:37.641226 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:37.641682 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:37.642458 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:37.642899 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:37.674985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:37.675441 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:37.675898 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lazy-loading 'fault' on Instance uuid 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:22:37.721431 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:37.729394 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a55610f7-8558-4f22-99fd-3336947976e7 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 200 len: 1331 microversion: 2.1 time: 0.110377 Jul 04 09:22:37.729958 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 254/490] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:37 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:38.634587 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e984d185-0fa4-4436-9022-8c8120ea87ea tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:38.635207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e984d185-0fa4-4436-9022-8c8120ea87ea tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:38.642863 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e984d185-0fa4-4436-9022-8c8120ea87ea tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:38.643331 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e984d185-0fa4-4436-9022-8c8120ea87ea tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:38.644134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e984d185-0fa4-4436-9022-8c8120ea87ea tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:38.644579 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e984d185-0fa4-4436-9022-8c8120ea87ea tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:38.645292 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6beb9a8e-a11a-4610-b7bf-a945b7f7a1c3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:38.645899 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6beb9a8e-a11a-4610-b7bf-a945b7f7a1c3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:38.648331 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=78 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:38.653534 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6beb9a8e-a11a-4610-b7bf-a945b7f7a1c3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:38.654090 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6beb9a8e-a11a-4610-b7bf-a945b7f7a1c3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:38.655290 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6beb9a8e-a11a-4610-b7bf-a945b7f7a1c3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:38.655729 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6beb9a8e-a11a-4610-b7bf-a945b7f7a1c3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:38.839001 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e984d185-0fa4-4436-9022-8c8120ea87ea tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:38.846267 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6beb9a8e-a11a-4610-b7bf-a945b7f7a1c3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:38.847367 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e984d185-0fa4-4436-9022-8c8120ea87ea tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1510 microversion: 2.1 time: 0.216596 Jul 04 09:22:38.847933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 237/491] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:38 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:38.852477 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2354c382-c0de-4fe0-be5c-76a14061c857 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:38.853098 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2354c382-c0de-4fe0-be5c-76a14061c857 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:38.855188 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6beb9a8e-a11a-4610-b7bf-a945b7f7a1c3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:38.857553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6beb9a8e-a11a-4610-b7bf-a945b7f7a1c3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:38.858818 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6beb9a8e-a11a-4610-b7bf-a945b7f7a1c3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1796 microversion: 2.20 time: 0.217577 Jul 04 09:22:38.859453 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 255/492] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:22:38 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1796 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:22:38.860037 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2354c382-c0de-4fe0-be5c-76a14061c857 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:38.860570 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2354c382-c0de-4fe0-be5c-76a14061c857 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:38.861371 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2354c382-c0de-4fe0-be5c-76a14061c857 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:38.861809 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2354c382-c0de-4fe0-be5c-76a14061c857 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:38.877170 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-2354c382-c0de-4fe0-be5c-76a14061c857 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2354c382-c0de-4fe0-be5c-76a14061c857 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e HTTP/1.1 Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:22:38.878694 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:22:38.880176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e'} Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:22:38.881024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:22:38.882452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:38.883721 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2354c382-c0de-4fe0-be5c-76a14061c857 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:22:38.883721 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2354c382-c0de-4fe0-be5c-76a14061c857 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 404 len: 111 microversion: 2.1 time: 0.031216 Jul 04 09:22:38.883721 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 238/493] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:38 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:22:38.889228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f3aa7a77-3836-4426-bd26-2a16fe90a4f2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '.version_select at 0x7fad7ac35700>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:38.908915 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f3aa7a77-3836-4426-bd26-2a16fe90a4f2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-214595318" status: 202 len: 0 microversion: 2.1 time: 0.023700 Jul 04 09:22:38.909836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 256/494] 10.222.0.71 () {58 vars in 1217 bytes} [Mon Jul 4 09:22:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-214595318 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:22:39.581283 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c39b0407-31a7-4390-be2d-cb7e9e4eeb29 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:39.581787 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c39b0407-31a7-4390-be2d-cb7e9e4eeb29 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:39.588121 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c39b0407-31a7-4390-be2d-cb7e9e4eeb29 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:39.588577 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c39b0407-31a7-4390-be2d-cb7e9e4eeb29 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:39.589393 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c39b0407-31a7-4390-be2d-cb7e9e4eeb29 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:39.589840 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c39b0407-31a7-4390-be2d-cb7e9e4eeb29 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:39.671054 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-c39b0407-31a7-4390-be2d-cb7e9e4eeb29 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lazy-loading 'services' on Instance uuid 1df7890f-b2e1-476d-a951-8ad28d7ff91b {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:22:39.744955 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c39b0407-31a7-4390-be2d-cb7e9e4eeb29 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments/a16d928d-da6f-4ed0-8413-0ea907bc4c19" status: 202 len: 0 microversion: 2.1 time: 0.167393 Jul 04 09:22:39.745597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 239/495] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:22:39 2022] DELETE /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments/a16d928d-da6f-4ed0-8413-0ea907bc4c19 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:22:39.754060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fbb1a1de-1ce8-472d-94a8-1049a05a9d8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:39.755006 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fbb1a1de-1ce8-472d-94a8-1049a05a9d8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:39.762531 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fbb1a1de-1ce8-472d-94a8-1049a05a9d8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:39.762994 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fbb1a1de-1ce8-472d-94a8-1049a05a9d8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:39.764333 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fbb1a1de-1ce8-472d-94a8-1049a05a9d8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:39.764732 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fbb1a1de-1ce8-472d-94a8-1049a05a9d8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:39.793861 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fbb1a1de-1ce8-472d-94a8-1049a05a9d8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043760 Jul 04 09:22:39.794473 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 257/496] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:22:39 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:39.866421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2d3424da-b532-4bf0-989a-2402f04ae868 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:39.867597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2d3424da-b532-4bf0-989a-2402f04ae868 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:39.874470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2d3424da-b532-4bf0-989a-2402f04ae868 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:39.874933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2d3424da-b532-4bf0-989a-2402f04ae868 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:39.875700 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2d3424da-b532-4bf0-989a-2402f04ae868 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:39.876144 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2d3424da-b532-4bf0-989a-2402f04ae868 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:40.007000 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2d3424da-b532-4bf0-989a-2402f04ae868 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:40.015079 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2d3424da-b532-4bf0-989a-2402f04ae868 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1510 microversion: 2.1 time: 0.155058 Jul 04 09:22:40.015645 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 240/497] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:39 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:40.805593 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b9858ce0-afb6-4d69-b00a-3b86f47a2a8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:40.806516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b9858ce0-afb6-4d69-b00a-3b86f47a2a8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:40.813200 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b9858ce0-afb6-4d69-b00a-3b86f47a2a8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:40.813659 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b9858ce0-afb6-4d69-b00a-3b86f47a2a8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:40.814425 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b9858ce0-afb6-4d69-b00a-3b86f47a2a8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:40.814869 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b9858ce0-afb6-4d69-b00a-3b86f47a2a8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:40.818552 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:40.848415 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b9858ce0-afb6-4d69-b00a-3b86f47a2a8e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046705 Jul 04 09:22:40.848984 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 258/498] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:22:40 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:41.032289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d0c1bebd-9933-4f75-ad20-dfdbb0716af6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:41.032908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d0c1bebd-9933-4f75-ad20-dfdbb0716af6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:41.039583 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d0c1bebd-9933-4f75-ad20-dfdbb0716af6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:41.040043 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d0c1bebd-9933-4f75-ad20-dfdbb0716af6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:41.040808 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d0c1bebd-9933-4f75-ad20-dfdbb0716af6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:41.041362 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d0c1bebd-9933-4f75-ad20-dfdbb0716af6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:41.107134 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3b4c8004-c5b9-4b2b-9c1e-294f61ae18a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:41.107962 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3b4c8004-c5b9-4b2b-9c1e-294f61ae18a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:41.114044 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3b4c8004-c5b9-4b2b-9c1e-294f61ae18a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:41.114504 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3b4c8004-c5b9-4b2b-9c1e-294f61ae18a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:41.115280 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3b4c8004-c5b9-4b2b-9c1e-294f61ae18a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:41.115724 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3b4c8004-c5b9-4b2b-9c1e-294f61ae18a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:41.174919 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d0c1bebd-9933-4f75-ad20-dfdbb0716af6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:41.182432 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d0c1bebd-9933-4f75-ad20-dfdbb0716af6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1516 microversion: 2.1 time: 0.154502 Jul 04 09:22:41.183004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 241/499] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:41 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:41.242031 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-3b4c8004-c5b9-4b2b-9c1e-294f61ae18a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lazy-loading 'services' on Instance uuid 005a3614-439a-4f93-8af0-69956acdcd99 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:22:41.364868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3b4c8004-c5b9-4b2b-9c1e-294f61ae18a1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "DELETE /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99/os-volume_attachments/8e576b2f-9377-49d5-aac0-05f7cd8d91a1" status: 202 len: 0 microversion: 2.1 time: 0.261607 Jul 04 09:22:41.365513 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 259/500] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:22:41 2022] DELETE /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99/os-volume_attachments/8e576b2f-9377-49d5-aac0-05f7cd8d91a1 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:22:41.861564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-96882799-9aac-4acf-92a7-71ad3afb4e6f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:41.862479 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-96882799-9aac-4acf-92a7-71ad3afb4e6f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:41.868426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-96882799-9aac-4acf-92a7-71ad3afb4e6f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:41.868883 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-96882799-9aac-4acf-92a7-71ad3afb4e6f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:41.869691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-96882799-9aac-4acf-92a7-71ad3afb4e6f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:41.870153 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-96882799-9aac-4acf-92a7-71ad3afb4e6f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:41.901682 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-96882799-9aac-4acf-92a7-71ad3afb4e6f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045662 Jul 04 09:22:41.902237 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 242/501] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:22:41 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:42.542919 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c560d2cf-dbea-451d-b23f-aee854f5db45 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'create', calling method: .version_select at 0x7fad7ac5ed30>, body: {"keypair": {"name": "tempest-keypair-871394876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbtvMxihr3Kx/o3Yn1SSGgeLqVDDhuDYZm7OFwBYJUcw4LVVWdNuQshiN8qBdmI6HN0dpnJgiFKAxrGSK72vd7oYjPpZGtlUXw2FnCa7aoZ5I2ag1Un+VOU5J7jtF5URw=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:42.557385 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-c560d2cf-dbea-451d-b23f-aee854f5db45 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Getting quotas for project 930dc66606e94d9eb82cc50a67d009fb. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:22:42.561314 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-c560d2cf-dbea-451d-b23f-aee854f5db45 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Getting quotas for user 9bcf554f3d6447399e1d9cfe08b0bff7 and project 930dc66606e94d9eb82cc50a67d009fb. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:22:42.582776 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c560d2cf-dbea-451d-b23f-aee854f5db45 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044542 Jul 04 09:22:42.583369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 260/502] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 4 09:22:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:42.914490 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6fa66376-2935-45e2-a294-4e84c563760a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:42.915495 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6fa66376-2935-45e2-a294-4e84c563760a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:42.922692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6fa66376-2935-45e2-a294-4e84c563760a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:42.923245 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6fa66376-2935-45e2-a294-4e84c563760a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:42.924110 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6fa66376-2935-45e2-a294-4e84c563760a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:42.924739 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6fa66376-2935-45e2-a294-4e84c563760a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:42.956886 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6fa66376-2935-45e2-a294-4e84c563760a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047834 Jul 04 09:22:42.957496 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 243/503] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:22:42 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:22:43.023486 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9d94a806-180f-45bc-923d-8763deec44d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:43.024110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9d94a806-180f-45bc-923d-8763deec44d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:43.030988 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d94a806-180f-45bc-923d-8763deec44d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:43.031443 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d94a806-180f-45bc-923d-8763deec44d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:43.032214 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d94a806-180f-45bc-923d-8763deec44d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:43.032655 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d94a806-180f-45bc-923d-8763deec44d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:43.057616 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9d94a806-180f-45bc-923d-8763deec44d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:22:43.136798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9d94a806-180f-45bc-923d-8763deec44d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 204 len: 0 microversion: 2.1 time: 0.116867 Jul 04 09:22:43.141101 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 261/504] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:22:43 2022] DELETE /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 09:22:43.146155 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-eb5b4cf8-4f37-42b8-9658-15e7e73b9797 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:43.146787 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-eb5b4cf8-4f37-42b8-9658-15e7e73b9797 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:43.154715 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb5b4cf8-4f37-42b8-9658-15e7e73b9797 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:43.155323 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb5b4cf8-4f37-42b8-9658-15e7e73b9797 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:43.156184 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb5b4cf8-4f37-42b8-9658-15e7e73b9797 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:43.156638 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb5b4cf8-4f37-42b8-9658-15e7e73b9797 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:43.370427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-eb5b4cf8-4f37-42b8-9658-15e7e73b9797 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:43.378368 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-eb5b4cf8-4f37-42b8-9658-15e7e73b9797 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1680 microversion: 2.1 time: 0.235952 Jul 04 09:22:43.379175 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 244/505] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:43 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:43.544055 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-eed68454-0395-441e-ab4d-a207c848bd22 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:43.545159 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-eed68454-0395-441e-ab4d-a207c848bd22 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:43.551121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eed68454-0395-441e-ab4d-a207c848bd22 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:43.551583 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eed68454-0395-441e-ab4d-a207c848bd22 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:43.552347 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eed68454-0395-441e-ab4d-a207c848bd22 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:43.552789 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-eed68454-0395-441e-ab4d-a207c848bd22 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:43.579314 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-eed68454-0395-441e-ab4d-a207c848bd22 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:22:43.656486 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-eed68454-0395-441e-ab4d-a207c848bd22 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "DELETE /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 204 len: 0 microversion: 2.1 time: 0.116331 Jul 04 09:22:43.657274 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 262/506] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:22:43 2022] DELETE /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:22:43.665700 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dccc5722-30f6-4bf5-94b1-058d3ffda3f1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:43.666419 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dccc5722-30f6-4bf5-94b1-058d3ffda3f1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:43.672759 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dccc5722-30f6-4bf5-94b1-058d3ffda3f1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:43.673340 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dccc5722-30f6-4bf5-94b1-058d3ffda3f1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:43.674187 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dccc5722-30f6-4bf5-94b1-058d3ffda3f1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:43.674723 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dccc5722-30f6-4bf5-94b1-058d3ffda3f1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:43.678975 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:43.910877 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dccc5722-30f6-4bf5-94b1-058d3ffda3f1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:43.918920 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dccc5722-30f6-4bf5-94b1-058d3ffda3f1 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1513 microversion: 2.1 time: 0.257256 Jul 04 09:22:43.919667 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 245/507] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:43 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:44.031689 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-568096372", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0234e96f-0fff-4fe1-a682-0984ac2a09a5"}], "security_groups": [{"name": "tempest-securitygroup--1257094472"}], "key_name": "tempest-keypair-871394876", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:44.133318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] validate_networks() for [('0234e96f-0fff-4fe1-a682-0984ac2a09a5', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:22:44.270653 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-587d8c25-491c-4b7d-a461-e498e451bb82 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:44.271144 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-587d8c25-491c-4b7d-a461-e498e451bb82 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:44.277430 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-587d8c25-491c-4b7d-a461-e498e451bb82 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:44.277909 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-587d8c25-491c-4b7d-a461-e498e451bb82 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:44.278673 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-587d8c25-491c-4b7d-a461-e498e451bb82 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:44.280008 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-587d8c25-491c-4b7d-a461-e498e451bb82 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:44.365804 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-587d8c25-491c-4b7d-a461-e498e451bb82 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lazy-loading 'services' on Instance uuid 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:22:44.444824 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-587d8c25-491c-4b7d-a461-e498e451bb82 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/os-volume_attachments/1c9432f6-cc12-4227-a48c-88ac4f567701" status: 202 len: 0 microversion: 2.1 time: 0.177840 Jul 04 09:22:44.445439 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 246/508] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:22:44 2022] DELETE /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/os-volume_attachments/1c9432f6-cc12-4227-a48c-88ac4f567701 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:22:44.450459 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-58752867-1234-4a1f-b0ab-34c5ae3e8c89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:44.451456 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-58752867-1234-4a1f-b0ab-34c5ae3e8c89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:44.457676 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58752867-1234-4a1f-b0ab-34c5ae3e8c89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:44.458126 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58752867-1234-4a1f-b0ab-34c5ae3e8c89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:44.458896 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58752867-1234-4a1f-b0ab-34c5ae3e8c89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:44.459331 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58752867-1234-4a1f-b0ab-34c5ae3e8c89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:44.571323 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:22:44.571816 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:22:44.572285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:22:44.572694 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:22:44.573132 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:22:44.582383 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:44.582832 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:44.583620 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:44.584054 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:44.602335 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Getting quotas for project 930dc66606e94d9eb82cc50a67d009fb. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:22:44.606237 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Getting quotas for user 9bcf554f3d6447399e1d9cfe08b0bff7 and project 930dc66606e94d9eb82cc50a67d009fb. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:22:44.615727 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-58752867-1234-4a1f-b0ab-34c5ae3e8c89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:44.618591 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:22:44.620926 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:22:44.624014 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-58752867-1234-4a1f-b0ab-34c5ae3e8c89 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1680 microversion: 2.1 time: 0.177459 Jul 04 09:22:44.624593 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 247/509] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:44 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:44.668942 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b5e0f05f-0a9c-493e-8718-da89ab9fd1c0 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.642257 Jul 04 09:22:44.669981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 263/510] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:22:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:22:44.679495 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bded85d8-28d8-4358-b862-83e41299a02a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:44.680145 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bded85d8-28d8-4358-b862-83e41299a02a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:44.733584 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-bded85d8-28d8-4358-b862-83e41299a02a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:44.741093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bded85d8-28d8-4358-b862-83e41299a02a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1244 microversion: 2.1 time: 0.065179 Jul 04 09:22:44.742061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 248/511] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:44 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1244 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:44.936978 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cb337564-29d4-481c-975c-9301833e7956 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:44.937900 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cb337564-29d4-481c-975c-9301833e7956 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:44.944414 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb337564-29d4-481c-975c-9301833e7956 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:44.945198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb337564-29d4-481c-975c-9301833e7956 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:44.946077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb337564-29d4-481c-975c-9301833e7956 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:44.946621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cb337564-29d4-481c-975c-9301833e7956 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:45.099068 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cb337564-29d4-481c-975c-9301833e7956 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:45.107272 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cb337564-29d4-481c-975c-9301833e7956 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1513 microversion: 2.1 time: 0.174268 Jul 04 09:22:45.107838 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 264/512] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:44 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:45.641681 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c19b107a-4dd6-449c-9c94-3601f3ed6617 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:45.642302 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c19b107a-4dd6-449c-9c94-3601f3ed6617 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:45.648406 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c19b107a-4dd6-449c-9c94-3601f3ed6617 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:45.648810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c19b107a-4dd6-449c-9c94-3601f3ed6617 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:45.649781 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c19b107a-4dd6-449c-9c94-3601f3ed6617 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:45.650231 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c19b107a-4dd6-449c-9c94-3601f3ed6617 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:45.758846 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-71678ab2-3508-42ad-8034-d91c25559afb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:45.759664 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-71678ab2-3508-42ad-8034-d91c25559afb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:45.767116 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71678ab2-3508-42ad-8034-d91c25559afb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:45.767573 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71678ab2-3508-42ad-8034-d91c25559afb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:45.768353 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71678ab2-3508-42ad-8034-d91c25559afb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:45.768794 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71678ab2-3508-42ad-8034-d91c25559afb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:45.777965 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c19b107a-4dd6-449c-9c94-3601f3ed6617 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:45.785600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c19b107a-4dd6-449c-9c94-3601f3ed6617 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1680 microversion: 2.1 time: 0.148088 Jul 04 09:22:45.786175 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 249/513] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:45 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:45.831878 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-71678ab2-3508-42ad-8034-d91c25559afb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:45.839154 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-71678ab2-3508-42ad-8034-d91c25559afb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1248 microversion: 2.1 time: 0.084193 Jul 04 09:22:45.839720 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 265/514] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:45 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:46.123428 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e2b6ec3b-00a1-44dd-b944-7158ccc69848 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:46.124041 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e2b6ec3b-00a1-44dd-b944-7158ccc69848 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:46.130160 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2b6ec3b-00a1-44dd-b944-7158ccc69848 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:46.130622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2b6ec3b-00a1-44dd-b944-7158ccc69848 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:46.131398 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2b6ec3b-00a1-44dd-b944-7158ccc69848 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:46.131844 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2b6ec3b-00a1-44dd-b944-7158ccc69848 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:46.261656 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e2b6ec3b-00a1-44dd-b944-7158ccc69848 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:46.269627 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e2b6ec3b-00a1-44dd-b944-7158ccc69848 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1513 microversion: 2.1 time: 0.150117 Jul 04 09:22:46.270196 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 250/515] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:46 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:46.803836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f7e0e46d-55d0-4cc8-969c-66a633f05d0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:46.804443 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f7e0e46d-55d0-4cc8-969c-66a633f05d0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:46.811955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7e0e46d-55d0-4cc8-969c-66a633f05d0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:46.812399 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7e0e46d-55d0-4cc8-969c-66a633f05d0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:46.813184 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7e0e46d-55d0-4cc8-969c-66a633f05d0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:46.813621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f7e0e46d-55d0-4cc8-969c-66a633f05d0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:46.855163 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-21256905-785d-409d-b1d9-03d4849610b7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:46.855764 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-21256905-785d-409d-b1d9-03d4849610b7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:46.863248 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21256905-785d-409d-b1d9-03d4849610b7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:46.863708 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21256905-785d-409d-b1d9-03d4849610b7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:46.864490 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21256905-785d-409d-b1d9-03d4849610b7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:46.864933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-21256905-785d-409d-b1d9-03d4849610b7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:46.951704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-21256905-785d-409d-b1d9-03d4849610b7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:46.959478 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-21256905-785d-409d-b1d9-03d4849610b7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1248 microversion: 2.1 time: 0.108089 Jul 04 09:22:46.969168 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 251/516] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:46 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1248 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:46.980900 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f7e0e46d-55d0-4cc8-969c-66a633f05d0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:46.988815 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f7e0e46d-55d0-4cc8-969c-66a633f05d0a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1680 microversion: 2.1 time: 0.188853 Jul 04 09:22:46.989625 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 266/517] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:46 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:47.287171 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-319780e2-0d2f-4bb4-b70e-79304c6e8bb2 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:47.287781 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-319780e2-0d2f-4bb4-b70e-79304c6e8bb2 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:47.293823 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-319780e2-0d2f-4bb4-b70e-79304c6e8bb2 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:47.294973 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-319780e2-0d2f-4bb4-b70e-79304c6e8bb2 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:47.296037 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-319780e2-0d2f-4bb4-b70e-79304c6e8bb2 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:47.296474 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-319780e2-0d2f-4bb4-b70e-79304c6e8bb2 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:47.427040 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-319780e2-0d2f-4bb4-b70e-79304c6e8bb2 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:47.436072 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-319780e2-0d2f-4bb4-b70e-79304c6e8bb2 tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1513 microversion: 2.1 time: 0.151845 Jul 04 09:22:47.437202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 252/518] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:47 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:47.976571 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-656968d5-35f6-4475-b50e-8c7bcff896b9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:47.977349 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-656968d5-35f6-4475-b50e-8c7bcff896b9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:47.984721 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-656968d5-35f6-4475-b50e-8c7bcff896b9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:47.985306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-656968d5-35f6-4475-b50e-8c7bcff896b9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:47.986092 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-656968d5-35f6-4475-b50e-8c7bcff896b9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:47.986709 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-656968d5-35f6-4475-b50e-8c7bcff896b9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:48.007518 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-070b82a7-a674-436a-bd24-06e77e2f7509 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:48.008146 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-070b82a7-a674-436a-bd24-06e77e2f7509 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:48.016706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-070b82a7-a674-436a-bd24-06e77e2f7509 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:48.017297 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-070b82a7-a674-436a-bd24-06e77e2f7509 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:48.018274 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-070b82a7-a674-436a-bd24-06e77e2f7509 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:48.018901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-070b82a7-a674-436a-bd24-06e77e2f7509 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:48.090985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-656968d5-35f6-4475-b50e-8c7bcff896b9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:48.100219 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-656968d5-35f6-4475-b50e-8c7bcff896b9 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1314 microversion: 2.1 time: 0.127634 Jul 04 09:22:48.111262 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 267/519] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:47 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:48.220809 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-070b82a7-a674-436a-bd24-06e77e2f7509 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:48.229453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-070b82a7-a674-436a-bd24-06e77e2f7509 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1680 microversion: 2.1 time: 0.225740 Jul 04 09:22:48.230161 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 253/520] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:48 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1680 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:48.455478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bc7819b3-856c-4911-9c9b-6fab1853289a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:48.456215 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bc7819b3-856c-4911-9c9b-6fab1853289a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:48.463357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bc7819b3-856c-4911-9c9b-6fab1853289a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:48.463897 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bc7819b3-856c-4911-9c9b-6fab1853289a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:48.464910 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bc7819b3-856c-4911-9c9b-6fab1853289a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:48.465734 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bc7819b3-856c-4911-9c9b-6fab1853289a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:48.535929 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bc7819b3-856c-4911-9c9b-6fab1853289a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f1d0ab53de4473acee63b55bf14cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bc6b8b0235439587a3a5c9e837d708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:48.543664 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bc7819b3-856c-4911-9c9b-6fab1853289a tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 200 len: 1471 microversion: 2.1 time: 0.092829 Jul 04 09:22:48.546288 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 268/521] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:48 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:48.603047 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-33b1dc4a-c490-4bea-945b-e7929ed8346b req-0a08a807-dec0-45aa-b060-5a5ebe7c0d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "005a3614-439a-4f93-8af0-69956acdcd99", "name": "network-vif-deleted", "tag": "99842618-f7e3-45be-a5c4-915798a01e04"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:48.612078 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-33b1dc4a-c490-4bea-945b-e7929ed8346b req-0a08a807-dec0-45aa-b060-5a5ebe7c0d03 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:48.612889 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-33b1dc4a-c490-4bea-945b-e7929ed8346b req-0a08a807-dec0-45aa-b060-5a5ebe7c0d03 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:48.626959 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-33b1dc4a-c490-4bea-945b-e7929ed8346b req-0a08a807-dec0-45aa-b060-5a5ebe7c0d03 service nova] Creating event network-vif-deleted:99842618-f7e3-45be-a5c4-915798a01e04 for instance 005a3614-439a-4f93-8af0-69956acdcd99 on hv-cinder-84456 Jul 04 09:22:48.631835 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-33b1dc4a-c490-4bea-945b-e7929ed8346b req-0a08a807-dec0-45aa-b060-5a5ebe7c0d03 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032942 Jul 04 09:22:48.632431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 254/522] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:48.729067 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-67c23142-6cef-4b36-881a-d134e701c97c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:48.736644 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67c23142-6cef-4b36-881a-d134e701c97c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:48.737139 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67c23142-6cef-4b36-881a-d134e701c97c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:48.760160 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-67c23142-6cef-4b36-881a-d134e701c97c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Going to try to stop instance {{(pid=117664) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 09:22:48.808277 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-67c23142-6cef-4b36-881a-d134e701c97c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/action" status: 202 len: 0 microversion: 2.1 time: 0.083444 Jul 04 09:22:48.809083 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 269/523] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:22:48 2022] POST /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:22:48.817518 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-37ea4c0a-6a51-4412-b407-33eeef1987c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:48.818235 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-37ea4c0a-6a51-4412-b407-33eeef1987c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:48.824420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-37ea4c0a-6a51-4412-b407-33eeef1987c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:48.824880 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-37ea4c0a-6a51-4412-b407-33eeef1987c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:48.826219 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-37ea4c0a-6a51-4412-b407-33eeef1987c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:48.826664 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-37ea4c0a-6a51-4412-b407-33eeef1987c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:48.958702 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-37ea4c0a-6a51-4412-b407-33eeef1987c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:48.966507 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-37ea4c0a-6a51-4412-b407-33eeef1987c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.153148 Jul 04 09:22:48.967080 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 255/524] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:48 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:49.120483 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-48ad51dd-1d04-48c2-9334-2489ad497c6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:49.122124 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-48ad51dd-1d04-48c2-9334-2489ad497c6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:49.130247 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48ad51dd-1d04-48c2-9334-2489ad497c6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:49.131098 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48ad51dd-1d04-48c2-9334-2489ad497c6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:49.132103 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48ad51dd-1d04-48c2-9334-2489ad497c6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:49.132716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48ad51dd-1d04-48c2-9334-2489ad497c6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:49.227528 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-48ad51dd-1d04-48c2-9334-2489ad497c6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:49.250431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-53257fbc-6b44-42db-b6be-6509db7ae59f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:49.251731 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-53257fbc-6b44-42db-b6be-6509db7ae59f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:49.256368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-48ad51dd-1d04-48c2-9334-2489ad497c6d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1302 microversion: 2.1 time: 0.126986 Jul 04 09:22:49.258704 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 270/525] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:49 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1302 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:49.261242 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53257fbc-6b44-42db-b6be-6509db7ae59f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:49.261928 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53257fbc-6b44-42db-b6be-6509db7ae59f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:49.263158 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53257fbc-6b44-42db-b6be-6509db7ae59f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:49.264507 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53257fbc-6b44-42db-b6be-6509db7ae59f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:49.371066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-53257fbc-6b44-42db-b6be-6509db7ae59f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:49.384680 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-53257fbc-6b44-42db-b6be-6509db7ae59f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 200 len: 1613 microversion: 2.1 time: 0.138041 Jul 04 09:22:49.393697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 256/526] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:49 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 1613 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:49.562483 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4f3f1086-9a14-4d7b-bfa2-9da4f776e02b tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:49.564252 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4f3f1086-9a14-4d7b-bfa2-9da4f776e02b tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] [instance: 005a3614-439a-4f93-8af0-69956acdcd99] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:49.579467 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f3f1086-9a14-4d7b-bfa2-9da4f776e02b tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:49.580074 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f3f1086-9a14-4d7b-bfa2-9da4f776e02b tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:49.581283 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f3f1086-9a14-4d7b-bfa2-9da4f776e02b tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:49.581897 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4f3f1086-9a14-4d7b-bfa2-9da4f776e02b tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:49.605411 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-4f3f1086-9a14-4d7b-bfa2-9da4f776e02b tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] HTTP exception thrown: Instance 005a3614-439a-4f93-8af0-69956acdcd99 could not be found. Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4f3f1086-9a14-4d7b-bfa2-9da4f776e02b tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Request method failure captured: Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 HTTP/1.1 Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrDbPb1VNFHlx2Yfjr1xe6O8XXvS6upeUODc-6VbMO21Md7MvWJV4MWqCk--52qKrPDCS23-FKx4jkOjnih5ePakPN-dSTDkGAo4bgzPjROXmDIAUkbQwzhbT6_D4tlNYOQATsBX-KajOoUDgNKG4yybz59Kqg69qvoVpy8mmJ2a8v4 Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 96bc6b8b0235439587a3a5c9e837d708 Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1846238443 Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:22:49.608302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/96bc6b8b0235439587a3a5c9e837d708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/96bc6b8b0235439587a3a5c9e837d708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/96bc6b8b0235439587a3a5c9e837d708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_96bc6b8b0235439587a3a5c9e837d708", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesSnapshotTestJSON-1846238443 Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 96bc6b8b0235439587a3a5c9e837d708 Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1846238443 Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesSnapshotTestJSON-1846238443-project Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 65f1d0ab53de4473acee63b55bf14cab Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesSnapshotTestJSON-1846238443-project Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 005a3614-439a-4f93-8af0-69956acdcd99 could not be found. Jul 04 09:22:49.610059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '005a3614-439a-4f93-8af0-69956acdcd99'} Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 005a3614-439a-4f93-8af0-69956acdcd99 could not be found. Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:22:49.610907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 005a3614-439a-4f93-8af0-69956acdcd99 could not be found. Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 005a3614-439a-4f93-8af0-69956acdcd99 could not be found. Jul 04 09:22:49.612654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:22:49.614099 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4f3f1086-9a14-4d7b-bfa2-9da4f776e02b tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] Returning 404 to user: Instance 005a3614-439a-4f93-8af0-69956acdcd99 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:22:49.614099 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4f3f1086-9a14-4d7b-bfa2-9da4f776e02b tempest-VolumesSnapshotTestJSON-1846238443 tempest-VolumesSnapshotTestJSON-1846238443-project] 10.222.0.71 "GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99" status: 404 len: 111 microversion: 2.1 time: 0.052296 Jul 04 09:22:49.614099 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 271/527] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:49 2022] GET /compute/v2.1/servers/005a3614-439a-4f93-8af0-69956acdcd99 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:22:49.986386 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6f1e7f26-0f77-4976-94b9-6296accb7bbf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:49.987956 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6f1e7f26-0f77-4976-94b9-6296accb7bbf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:49.995351 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f1e7f26-0f77-4976-94b9-6296accb7bbf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:49.996840 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f1e7f26-0f77-4976-94b9-6296accb7bbf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:49.998679 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f1e7f26-0f77-4976-94b9-6296accb7bbf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:49.999603 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6f1e7f26-0f77-4976-94b9-6296accb7bbf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:50.150495 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6f1e7f26-0f77-4976-94b9-6296accb7bbf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:50.158846 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6f1e7f26-0f77-4976-94b9-6296accb7bbf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.178522 Jul 04 09:22:50.159426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 257/528] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:49 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:50.275276 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ade59a6a-b512-42b8-962e-8a51d7a7b00e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:50.275972 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ade59a6a-b512-42b8-962e-8a51d7a7b00e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:50.284603 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ade59a6a-b512-42b8-962e-8a51d7a7b00e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:50.285447 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ade59a6a-b512-42b8-962e-8a51d7a7b00e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:50.286576 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ade59a6a-b512-42b8-962e-8a51d7a7b00e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:50.287174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ade59a6a-b512-42b8-962e-8a51d7a7b00e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:50.313280 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:50.402980 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-48e1dd7d-d732-4342-b6ad-79b1289fc075 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:50.404708 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-48e1dd7d-d732-4342-b6ad-79b1289fc075 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:50.418655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48e1dd7d-d732-4342-b6ad-79b1289fc075 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:50.419577 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48e1dd7d-d732-4342-b6ad-79b1289fc075 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:50.422094 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48e1dd7d-d732-4342-b6ad-79b1289fc075 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:50.422757 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48e1dd7d-d732-4342-b6ad-79b1289fc075 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:50.459019 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-48e1dd7d-d732-4342-b6ad-79b1289fc075 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-48e1dd7d-d732-4342-b6ad-79b1289fc075 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b HTTP/1.1 Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:22:50.460912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:22:50.462738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '1df7890f-b2e1-476d-a951-8ad28d7ff91b'} Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:22:50.463785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:22:50.465599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:22:50.468668 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-48e1dd7d-d732-4342-b6ad-79b1289fc075 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:22:50.470294 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-48e1dd7d-d732-4342-b6ad-79b1289fc075 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 404 len: 111 microversion: 2.1 time: 0.071326 Jul 04 09:22:50.475806 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 258/529] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:50 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:22:50.487694 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ade59a6a-b512-42b8-962e-8a51d7a7b00e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:50.495836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ade59a6a-b512-42b8-962e-8a51d7a7b00e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.225221 Jul 04 09:22:50.497142 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 272/530] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:50 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:50.504029 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3ddd48c2-a645-4ce4-99dd-e8360803be7b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '.version_select at 0x7fad7ab15940>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:50.536582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3ddd48c2-a645-4ce4-99dd-e8360803be7b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-68454639" status: 202 len: 0 microversion: 2.1 time: 0.053196 Jul 04 09:22:50.539107 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 259/531] 10.222.0.71 () {58 vars in 1214 bytes} [Mon Jul 4 09:22:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-68454639 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:22:50.668920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-6f1f6ba0-9b52-4f92-ab46-2dbddca95e0d req-a0e69aa1-9b6b-4658-9b7f-25ba3eddc7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df7890f-b2e1-476d-a951-8ad28d7ff91b", "name": "network-vif-deleted", "tag": "da60ee33-ffff-4869-9c04-6546c43a8492"}, {"name": "network-changed", "server_uuid": "80be812b-a9c3-4327-b55b-0dbcf97a12c7", "tag": "57ace4f7-2cc2-4fa1-b912-fdb4c747abf3"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:50.678950 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-6f1f6ba0-9b52-4f92-ab46-2dbddca95e0d req-a0e69aa1-9b6b-4658-9b7f-25ba3eddc7c4 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:50.679938 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-6f1f6ba0-9b52-4f92-ab46-2dbddca95e0d req-a0e69aa1-9b6b-4658-9b7f-25ba3eddc7c4 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:50.694692 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-6f1f6ba0-9b52-4f92-ab46-2dbddca95e0d req-a0e69aa1-9b6b-4658-9b7f-25ba3eddc7c4 service nova] Creating event network-vif-deleted:da60ee33-ffff-4869-9c04-6546c43a8492 for instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b on hv-cinder-84456 Jul 04 09:22:50.695564 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-6f1f6ba0-9b52-4f92-ab46-2dbddca95e0d req-a0e69aa1-9b6b-4658-9b7f-25ba3eddc7c4 service nova] Creating event network-changed:57ace4f7-2cc2-4fa1-b912-fdb4c747abf3 for instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 on hv-cinder-84456 Jul 04 09:22:50.704245 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-6f1f6ba0-9b52-4f92-ab46-2dbddca95e0d req-a0e69aa1-9b6b-4658-9b7f-25ba3eddc7c4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038806 Jul 04 09:22:50.705613 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 273/532] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:51.176967 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8a554e70-c751-44ec-8511-0396c57828b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:51.178820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8a554e70-c751-44ec-8511-0396c57828b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:51.188479 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8a554e70-c751-44ec-8511-0396c57828b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:51.189080 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8a554e70-c751-44ec-8511-0396c57828b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:51.190226 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8a554e70-c751-44ec-8511-0396c57828b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:51.190865 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8a554e70-c751-44ec-8511-0396c57828b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:51.349408 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8a554e70-c751-44ec-8511-0396c57828b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:51.357161 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8a554e70-c751-44ec-8511-0396c57828b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.185092 Jul 04 09:22:51.357692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 260/533] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:51 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:51.434677 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d71a0ad4-e6d0-49a6-97d5-bb96e8a33e3d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: .version_select at 0x7fad7abd8d30>, body: {"keypair": {"name": "tempest-keypair-853270730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM/1pKt/tbBxp0eW/cI1G+RgA+aAWBvrdT59dzNb4L9ER3z1jtoR0wM+zfNYQs4kCPYyQ5+CGALdA/L1Rv0OTDKRG5HKlml15CgD75PtBROsXVlcYnySQ5yFkIsCF7+QQ=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:51.449267 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-d71a0ad4-e6d0-49a6-97d5-bb96e8a33e3d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for project ba157b0e49f1447e82755035db8728d5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:22:51.454118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-d71a0ad4-e6d0-49a6-97d5-bb96e8a33e3d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for user 6bc30b7d536444008e5b5bab45c5c438 and project ba157b0e49f1447e82755035db8728d5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:22:51.475435 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d71a0ad4-e6d0-49a6-97d5-bb96e8a33e3d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045419 Jul 04 09:22:51.476014 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 274/534] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 4 09:22:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:51.514540 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a802f468-c933-47a1-b439-7e0a08d8f3d7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:51.515162 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a802f468-c933-47a1-b439-7e0a08d8f3d7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:51.521701 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a802f468-c933-47a1-b439-7e0a08d8f3d7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:51.522152 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a802f468-c933-47a1-b439-7e0a08d8f3d7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:51.522920 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a802f468-c933-47a1-b439-7e0a08d8f3d7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:51.523356 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a802f468-c933-47a1-b439-7e0a08d8f3d7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:51.680438 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a802f468-c933-47a1-b439-7e0a08d8f3d7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:51.688482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a802f468-c933-47a1-b439-7e0a08d8f3d7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.179059 Jul 04 09:22:51.689052 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 261/535] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:51 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:52.374986 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ed204bc0-6b81-4608-9f47-60838a6f4aa3 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:52.375742 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ed204bc0-6b81-4608-9f47-60838a6f4aa3 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:52.381945 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ed204bc0-6b81-4608-9f47-60838a6f4aa3 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:52.382391 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ed204bc0-6b81-4608-9f47-60838a6f4aa3 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:52.383162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ed204bc0-6b81-4608-9f47-60838a6f4aa3 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:52.383595 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ed204bc0-6b81-4608-9f47-60838a6f4aa3 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:52.706124 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3b88fcb5-897e-4a4e-97fa-61b98dfdf302 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:52.706666 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3b88fcb5-897e-4a4e-97fa-61b98dfdf302 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:52.713156 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3b88fcb5-897e-4a4e-97fa-61b98dfdf302 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:52.713606 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3b88fcb5-897e-4a4e-97fa-61b98dfdf302 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:52.714371 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3b88fcb5-897e-4a4e-97fa-61b98dfdf302 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:52.714804 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3b88fcb5-897e-4a4e-97fa-61b98dfdf302 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:52.811925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ed204bc0-6b81-4608-9f47-60838a6f4aa3 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:52.819615 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ed204bc0-6b81-4608-9f47-60838a6f4aa3 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.449238 Jul 04 09:22:52.820278 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 275/536] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:52 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:52.948928 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3b88fcb5-897e-4a4e-97fa-61b98dfdf302 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:52.957757 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3b88fcb5-897e-4a4e-97fa-61b98dfdf302 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.256704 Jul 04 09:22:52.958326 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 262/537] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:52 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:53.114174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2136705126", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599dfd4b-618e-4261-9f6d-462c4cc71e5b"}], "security_groups": [{"name": "tempest-securitygroup--51599217"}], "key_name": "tempest-keypair-853270730", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:53.213581 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] validate_networks() for [('599dfd4b-618e-4261-9f6d-462c4cc71e5b', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:22:53.579670 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:22:53.580105 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:22:53.580628 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:22:53.581057 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:22:53.581494 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:22:53.591885 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.592340 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.593178 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.593619 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.610383 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for project ba157b0e49f1447e82755035db8728d5. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:22:53.612562 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:53.614919 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for user 6bc30b7d536444008e5b5bab45c5c438 and project ba157b0e49f1447e82755035db8728d5. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:22:53.627866 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:22:53.630122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:22:53.676044 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-099f64e8-0b98-4f1d-b889-537180d259d6 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.566090 Jul 04 09:22:53.676614 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 276/538] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:22:53 2022] POST /compute/v2.1/servers => generated 400 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:22:53.687222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-699a19fc-6816-40c3-b2c6-5040c5b24ecf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:53.687834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-699a19fc-6816-40c3-b2c6-5040c5b24ecf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:53.742028 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-699a19fc-6816-40c3-b2c6-5040c5b24ecf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:53.751400 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-699a19fc-6816-40c3-b2c6-5040c5b24ecf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1241 microversion: 2.1 time: 0.068590 Jul 04 09:22:53.751977 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 263/539] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:53 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:53.837538 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c79bade6-f906-43b3-8b6f-ecd3ece6e112 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:53.838242 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c79bade6-f906-43b3-8b6f-ecd3ece6e112 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:53.844697 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c79bade6-f906-43b3-8b6f-ecd3ece6e112 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.845266 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c79bade6-f906-43b3-8b6f-ecd3ece6e112 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.846129 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c79bade6-f906-43b3-8b6f-ecd3ece6e112 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.846646 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c79bade6-f906-43b3-8b6f-ecd3ece6e112 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.974955 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ee5afff0-207a-4fb1-b825-74fdb9dca028 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:53.975568 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ee5afff0-207a-4fb1-b825-74fdb9dca028 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:53.982117 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ee5afff0-207a-4fb1-b825-74fdb9dca028 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.982857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ee5afff0-207a-4fb1-b825-74fdb9dca028 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.983364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ee5afff0-207a-4fb1-b825-74fdb9dca028 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:53.983804 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ee5afff0-207a-4fb1-b825-74fdb9dca028 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:53.991007 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c79bade6-f906-43b3-8b6f-ecd3ece6e112 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:54.000255 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c79bade6-f906-43b3-8b6f-ecd3ece6e112 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.166564 Jul 04 09:22:54.000847 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 277/540] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:53 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:54.119991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ee5afff0-207a-4fb1-b825-74fdb9dca028 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:54.127966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ee5afff0-207a-4fb1-b825-74fdb9dca028 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.156855 Jul 04 09:22:54.128528 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 264/541] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:53 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:54.768632 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fb5dd472-f826-4418-bc54-820cff903f41 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:54.769275 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fb5dd472-f826-4418-bc54-820cff903f41 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:54.775868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb5dd472-f826-4418-bc54-820cff903f41 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:54.776320 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb5dd472-f826-4418-bc54-820cff903f41 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:54.777105 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb5dd472-f826-4418-bc54-820cff903f41 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:54.777550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb5dd472-f826-4418-bc54-820cff903f41 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:54.843766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fb5dd472-f826-4418-bc54-820cff903f41 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:54.851209 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fb5dd472-f826-4418-bc54-820cff903f41 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1245 microversion: 2.1 time: 0.086473 Jul 04 09:22:54.851773 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 278/542] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:54 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:55.017844 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-912537dd-7cb9-42dc-8aa8-4f16b5978211 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:55.018470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-912537dd-7cb9-42dc-8aa8-4f16b5978211 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:55.025399 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-912537dd-7cb9-42dc-8aa8-4f16b5978211 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:55.026077 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-912537dd-7cb9-42dc-8aa8-4f16b5978211 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:55.027421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-912537dd-7cb9-42dc-8aa8-4f16b5978211 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:55.027968 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-912537dd-7cb9-42dc-8aa8-4f16b5978211 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:55.045545 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:55.144830 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a0dab76d-9025-4703-9045-755f9e051aae tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:55.145755 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a0dab76d-9025-4703-9045-755f9e051aae tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:55.152466 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0dab76d-9025-4703-9045-755f9e051aae tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:55.152921 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0dab76d-9025-4703-9045-755f9e051aae tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:55.153833 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0dab76d-9025-4703-9045-755f9e051aae tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:55.154276 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0dab76d-9025-4703-9045-755f9e051aae tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:55.175468 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-912537dd-7cb9-42dc-8aa8-4f16b5978211 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:55.183085 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-912537dd-7cb9-42dc-8aa8-4f16b5978211 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.169138 Jul 04 09:22:55.183660 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 265/543] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:55 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:55.297236 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a0dab76d-9025-4703-9045-755f9e051aae tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:55.304665 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a0dab76d-9025-4703-9045-755f9e051aae tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.164103 Jul 04 09:22:55.305257 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 279/544] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:55 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:55.869276 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-59de9f19-7938-4845-b8c1-5bce571bdd37 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:55.870219 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-59de9f19-7938-4845-b8c1-5bce571bdd37 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:55.876616 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59de9f19-7938-4845-b8c1-5bce571bdd37 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:55.877116 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59de9f19-7938-4845-b8c1-5bce571bdd37 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:55.877898 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59de9f19-7938-4845-b8c1-5bce571bdd37 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:55.878363 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59de9f19-7938-4845-b8c1-5bce571bdd37 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:55.944602 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-59de9f19-7938-4845-b8c1-5bce571bdd37 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:55.952188 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-59de9f19-7938-4845-b8c1-5bce571bdd37 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1299 microversion: 2.1 time: 0.086907 Jul 04 09:22:55.952756 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 266/545] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:55 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:56.199734 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ef298c34-d477-4963-9599-f997dd7155b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:56.200338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ef298c34-d477-4963-9599-f997dd7155b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:56.207731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef298c34-d477-4963-9599-f997dd7155b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.208177 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef298c34-d477-4963-9599-f997dd7155b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.208937 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef298c34-d477-4963-9599-f997dd7155b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.209426 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef298c34-d477-4963-9599-f997dd7155b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.321843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c543ace0-933a-4e46-a4cb-564310724785 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:56.334910 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c543ace0-933a-4e46-a4cb-564310724785 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:56.339490 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c543ace0-933a-4e46-a4cb-564310724785 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.340205 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c543ace0-933a-4e46-a4cb-564310724785 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.341863 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c543ace0-933a-4e46-a4cb-564310724785 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.342035 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c543ace0-933a-4e46-a4cb-564310724785 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.348949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ef298c34-d477-4963-9599-f997dd7155b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:56.357173 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ef298c34-d477-4963-9599-f997dd7155b6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.160587 Jul 04 09:22:56.366891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 280/546] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:56 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:56.491581 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c543ace0-933a-4e46-a4cb-564310724785 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:56.505618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c543ace0-933a-4e46-a4cb-564310724785 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.187696 Jul 04 09:22:56.506344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 267/547] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:56 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:56.970030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f447fb93-d230-4382-8e7a-c48e2621dabb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:56.970658 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f447fb93-d230-4382-8e7a-c48e2621dabb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:56.976835 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f447fb93-d230-4382-8e7a-c48e2621dabb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.977327 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f447fb93-d230-4382-8e7a-c48e2621dabb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:56.978106 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f447fb93-d230-4382-8e7a-c48e2621dabb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:56.978562 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f447fb93-d230-4382-8e7a-c48e2621dabb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:57.127106 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f447fb93-d230-4382-8e7a-c48e2621dabb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:57.135485 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f447fb93-d230-4382-8e7a-c48e2621dabb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1365 microversion: 2.1 time: 0.169734 Jul 04 09:22:57.136052 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 281/548] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:56 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:57.347580 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-578fe8a8-51ae-49ec-95a2-642e1eec45c7 req-b7119666-bf6e-45e8-8d75-083219877c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63068e8d-61aa-4db4-aa29-b3b179933ba9", "tag": "6bbe12ec-8feb-466a-93b3-661859e34233"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:22:57.359348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-578fe8a8-51ae-49ec-95a2-642e1eec45c7 req-b7119666-bf6e-45e8-8d75-083219877c07 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:57.360039 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-578fe8a8-51ae-49ec-95a2-642e1eec45c7 req-b7119666-bf6e-45e8-8d75-083219877c07 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:57.372349 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-578fe8a8-51ae-49ec-95a2-642e1eec45c7 req-b7119666-bf6e-45e8-8d75-083219877c07 service nova] Creating event network-changed:6bbe12ec-8feb-466a-93b3-661859e34233 for instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 on hv-cinder-84456 Jul 04 09:22:57.375999 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1869d696-6d9f-4149-8660-959cf9f195cf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:57.377271 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1869d696-6d9f-4149-8660-959cf9f195cf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:57.377463 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-578fe8a8-51ae-49ec-95a2-642e1eec45c7 req-b7119666-bf6e-45e8-8d75-083219877c07 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033426 Jul 04 09:22:57.378353 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 268/549] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:22:57.385065 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1869d696-6d9f-4149-8660-959cf9f195cf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:57.385583 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1869d696-6d9f-4149-8660-959cf9f195cf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:57.386521 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1869d696-6d9f-4149-8660-959cf9f195cf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:57.387095 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1869d696-6d9f-4149-8660-959cf9f195cf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:57.528286 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c704e2ce-f7d1-476f-a5ad-7eff87b097e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:57.531152 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c704e2ce-f7d1-476f-a5ad-7eff87b097e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:57.532952 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1869d696-6d9f-4149-8660-959cf9f195cf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:57.538762 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c704e2ce-f7d1-476f-a5ad-7eff87b097e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:57.539218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c704e2ce-f7d1-476f-a5ad-7eff87b097e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:57.541233 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c704e2ce-f7d1-476f-a5ad-7eff87b097e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:57.541788 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c704e2ce-f7d1-476f-a5ad-7eff87b097e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:57.542529 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1869d696-6d9f-4149-8660-959cf9f195cf tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.171720 Jul 04 09:22:57.543906 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 282/550] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:57 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:57.690049 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c704e2ce-f7d1-476f-a5ad-7eff87b097e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:57.697662 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c704e2ce-f7d1-476f-a5ad-7eff87b097e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.174431 Jul 04 09:22:57.698232 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 269/551] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:57 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:58.152949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d833b886-6c10-4077-88e8-aa70d36518ba tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:58.154210 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d833b886-6c10-4077-88e8-aa70d36518ba tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:58.163978 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d833b886-6c10-4077-88e8-aa70d36518ba tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:58.164318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d833b886-6c10-4077-88e8-aa70d36518ba tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:58.165133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d833b886-6c10-4077-88e8-aa70d36518ba tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:58.165592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d833b886-6c10-4077-88e8-aa70d36518ba tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:58.310834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d833b886-6c10-4077-88e8-aa70d36518ba tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:58.318738 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d833b886-6c10-4077-88e8-aa70d36518ba tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1365 microversion: 2.1 time: 0.169671 Jul 04 09:22:58.319233 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 283/552] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:58 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:58.560294 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4bab04f2-4dad-4e21-9bf3-00e8a3fbf9e0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:58.561010 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4bab04f2-4dad-4e21-9bf3-00e8a3fbf9e0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:58.567969 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4bab04f2-4dad-4e21-9bf3-00e8a3fbf9e0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:58.568428 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4bab04f2-4dad-4e21-9bf3-00e8a3fbf9e0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:58.569380 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4bab04f2-4dad-4e21-9bf3-00e8a3fbf9e0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:58.569765 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4bab04f2-4dad-4e21-9bf3-00e8a3fbf9e0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:58.710520 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4bab04f2-4dad-4e21-9bf3-00e8a3fbf9e0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:58.714381 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d2792de6-46c5-4708-b687-27770b263b50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:58.714996 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d2792de6-46c5-4708-b687-27770b263b50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:58.718776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4bab04f2-4dad-4e21-9bf3-00e8a3fbf9e0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.162380 Jul 04 09:22:58.719347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 270/553] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:58 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:58.722596 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2792de6-46c5-4708-b687-27770b263b50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:58.723047 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2792de6-46c5-4708-b687-27770b263b50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:58.723808 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2792de6-46c5-4708-b687-27770b263b50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:58.724239 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d2792de6-46c5-4708-b687-27770b263b50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:58.855846 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d2792de6-46c5-4708-b687-27770b263b50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:58.864077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d2792de6-46c5-4708-b687-27770b263b50 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.153411 Jul 04 09:22:58.864647 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 284/554] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:58 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:22:59.337458 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3a3c02b6-d4fc-475f-85e6-d8c5e610b8d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:59.338219 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3a3c02b6-d4fc-475f-85e6-d8c5e610b8d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:59.345604 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a3c02b6-d4fc-475f-85e6-d8c5e610b8d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.345911 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a3c02b6-d4fc-475f-85e6-d8c5e610b8d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:59.346692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a3c02b6-d4fc-475f-85e6-d8c5e610b8d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.347137 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a3c02b6-d4fc-475f-85e6-d8c5e610b8d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:59.508160 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3a3c02b6-d4fc-475f-85e6-d8c5e610b8d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:59.516363 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3a3c02b6-d4fc-475f-85e6-d8c5e610b8d0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1365 microversion: 2.1 time: 0.183212 Jul 04 09:22:59.516933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 271/555] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:59 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:59.735891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fd9b6546-8c99-4be3-b517-53354e21ef02 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:59.736505 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fd9b6546-8c99-4be3-b517-53354e21ef02 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:59.742995 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd9b6546-8c99-4be3-b517-53354e21ef02 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.743440 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd9b6546-8c99-4be3-b517-53354e21ef02 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:59.744199 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd9b6546-8c99-4be3-b517-53354e21ef02 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.744634 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd9b6546-8c99-4be3-b517-53354e21ef02 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:59.876091 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fd9b6546-8c99-4be3-b517-53354e21ef02 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:22:59.881402 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e730f7ec-f854-494e-8488-6f293012d686 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:22:59.882029 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e730f7ec-f854-494e-8488-6f293012d686 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:22:59.884300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fd9b6546-8c99-4be3-b517-53354e21ef02 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.152538 Jul 04 09:22:59.884472 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:22:59.884873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 285/556] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:59 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:22:59.891346 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e730f7ec-f854-494e-8488-6f293012d686 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.891812 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e730f7ec-f854-494e-8488-6f293012d686 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:22:59.892594 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e730f7ec-f854-494e-8488-6f293012d686 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:22:59.893054 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e730f7ec-f854-494e-8488-6f293012d686 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:00.024962 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e730f7ec-f854-494e-8488-6f293012d686 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:00.032708 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e730f7ec-f854-494e-8488-6f293012d686 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.155187 Jul 04 09:23:00.033328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 272/557] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:22:59 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:00.533893 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-38cfa2c8-b01b-479e-ad1e-afe4bdb4f8b9 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:00.534513 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-38cfa2c8-b01b-479e-ad1e-afe4bdb4f8b9 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:00.540542 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38cfa2c8-b01b-479e-ad1e-afe4bdb4f8b9 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:00.540994 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38cfa2c8-b01b-479e-ad1e-afe4bdb4f8b9 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:00.541826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38cfa2c8-b01b-479e-ad1e-afe4bdb4f8b9 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:00.542269 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38cfa2c8-b01b-479e-ad1e-afe4bdb4f8b9 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:00.674162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-38cfa2c8-b01b-479e-ad1e-afe4bdb4f8b9 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:00.681507 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-38cfa2c8-b01b-479e-ad1e-afe4bdb4f8b9 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1365 microversion: 2.1 time: 0.151392 Jul 04 09:23:00.682072 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 286/558] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:00 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:00.901423 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c7e7df2f-62d2-4b26-8cd8-8e7954fa9d6f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:00.902037 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c7e7df2f-62d2-4b26-8cd8-8e7954fa9d6f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:00.909407 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7e7df2f-62d2-4b26-8cd8-8e7954fa9d6f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:00.909863 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7e7df2f-62d2-4b26-8cd8-8e7954fa9d6f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:00.910634 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7e7df2f-62d2-4b26-8cd8-8e7954fa9d6f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:00.911077 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7e7df2f-62d2-4b26-8cd8-8e7954fa9d6f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:00.920863 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-e61d42d1-4304-4fe8-9602-b388c2d3a8e1 req-695691a3-487f-4951-8ba1-b045662e6ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80be812b-a9c3-4327-b55b-0dbcf97a12c7", "name": "network-vif-plugged", "status": "completed", "tag": "57ace4f7-2cc2-4fa1-b912-fdb4c747abf3"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:00.942063 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e61d42d1-4304-4fe8-9602-b388c2d3a8e1 req-695691a3-487f-4951-8ba1-b045662e6ecd service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:00.942494 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e61d42d1-4304-4fe8-9602-b388c2d3a8e1 req-695691a3-487f-4951-8ba1-b045662e6ecd service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:00.954584 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-e61d42d1-4304-4fe8-9602-b388c2d3a8e1 req-695691a3-487f-4951-8ba1-b045662e6ecd service nova] Creating event network-vif-plugged:57ace4f7-2cc2-4fa1-b912-fdb4c747abf3 for instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 on hv-cinder-84456 Jul 04 09:23:00.959444 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-e61d42d1-4304-4fe8-9602-b388c2d3a8e1 req-695691a3-487f-4951-8ba1-b045662e6ecd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043370 Jul 04 09:23:00.960034 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 287/559] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:01.051159 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-73d0b15f-b4d2-43a1-8c3e-6370c4d21e48 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:01.051891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-73d0b15f-b4d2-43a1-8c3e-6370c4d21e48 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:01.059630 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73d0b15f-b4d2-43a1-8c3e-6370c4d21e48 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:01.060357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73d0b15f-b4d2-43a1-8c3e-6370c4d21e48 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:01.061618 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73d0b15f-b4d2-43a1-8c3e-6370c4d21e48 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:01.062428 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-73d0b15f-b4d2-43a1-8c3e-6370c4d21e48 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:01.065186 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c7e7df2f-62d2-4b26-8cd8-8e7954fa9d6f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:01.072671 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c7e7df2f-62d2-4b26-8cd8-8e7954fa9d6f tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.175096 Jul 04 09:23:01.073263 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 273/560] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:00 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:01.194513 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-73d0b15f-b4d2-43a1-8c3e-6370c4d21e48 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:01.202057 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-73d0b15f-b4d2-43a1-8c3e-6370c4d21e48 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.155126 Jul 04 09:23:01.202621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 288/561] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:01 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:01.699152 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-17cb6079-8acc-430c-a3dc-e4b546340ac8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:01.699764 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-17cb6079-8acc-430c-a3dc-e4b546340ac8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:01.706164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-17cb6079-8acc-430c-a3dc-e4b546340ac8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:01.706657 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-17cb6079-8acc-430c-a3dc-e4b546340ac8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:01.707377 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-17cb6079-8acc-430c-a3dc-e4b546340ac8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:01.707819 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-17cb6079-8acc-430c-a3dc-e4b546340ac8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:01.837596 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-17cb6079-8acc-430c-a3dc-e4b546340ac8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:01.846071 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-17cb6079-8acc-430c-a3dc-e4b546340ac8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1365 microversion: 2.1 time: 0.150745 Jul 04 09:23:01.846614 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 274/562] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:01 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:02.091543 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8680decc-1b2a-49ce-ae2d-11791aedd85a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:02.092576 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8680decc-1b2a-49ce-ae2d-11791aedd85a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:02.098625 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8680decc-1b2a-49ce-ae2d-11791aedd85a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:02.099072 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8680decc-1b2a-49ce-ae2d-11791aedd85a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:02.099823 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8680decc-1b2a-49ce-ae2d-11791aedd85a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:02.100256 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8680decc-1b2a-49ce-ae2d-11791aedd85a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:02.219691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-53d644ab-bbaa-4a2e-a57a-6114609d1966 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:02.220311 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-53d644ab-bbaa-4a2e-a57a-6114609d1966 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:02.232318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8680decc-1b2a-49ce-ae2d-11791aedd85a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:02.232537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d644ab-bbaa-4a2e-a57a-6114609d1966 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:02.232929 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d644ab-bbaa-4a2e-a57a-6114609d1966 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:02.233754 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d644ab-bbaa-4a2e-a57a-6114609d1966 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:02.234239 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-53d644ab-bbaa-4a2e-a57a-6114609d1966 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:02.239832 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8680decc-1b2a-49ce-ae2d-11791aedd85a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.153289 Jul 04 09:23:02.245819 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 289/563] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:02 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:02.377264 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-53d644ab-bbaa-4a2e-a57a-6114609d1966 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:02.384852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-53d644ab-bbaa-4a2e-a57a-6114609d1966 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.170530 Jul 04 09:23:02.385637 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 275/564] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:02 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:02.866156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9c44f2ba-f652-485a-92a7-c9dfbba64714 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:02.866760 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9c44f2ba-f652-485a-92a7-c9dfbba64714 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:02.873609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9c44f2ba-f652-485a-92a7-c9dfbba64714 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:02.874070 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9c44f2ba-f652-485a-92a7-c9dfbba64714 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:02.874859 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9c44f2ba-f652-485a-92a7-c9dfbba64714 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:02.875298 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9c44f2ba-f652-485a-92a7-c9dfbba64714 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:03.026228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9c44f2ba-f652-485a-92a7-c9dfbba64714 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:03.034074 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9c44f2ba-f652-485a-92a7-c9dfbba64714 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1365 microversion: 2.1 time: 0.171747 Jul 04 09:23:03.034651 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 290/565] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:02 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:03.258036 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b53d56d5-32fd-42a1-b2fa-d7c05e7211f6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:03.259511 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b53d56d5-32fd-42a1-b2fa-d7c05e7211f6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:03.266798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b53d56d5-32fd-42a1-b2fa-d7c05e7211f6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:03.267245 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b53d56d5-32fd-42a1-b2fa-d7c05e7211f6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:03.268290 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b53d56d5-32fd-42a1-b2fa-d7c05e7211f6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:03.268942 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b53d56d5-32fd-42a1-b2fa-d7c05e7211f6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:03.402523 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-67aa1a4e-f257-4250-9023-f9fda8bf2987 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:03.403347 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-67aa1a4e-f257-4250-9023-f9fda8bf2987 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:03.405267 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b53d56d5-32fd-42a1-b2fa-d7c05e7211f6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:03.413025 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b53d56d5-32fd-42a1-b2fa-d7c05e7211f6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.159251 Jul 04 09:23:03.413536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67aa1a4e-f257-4250-9023-f9fda8bf2987 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:03.413676 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 276/566] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:03 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:03.414487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67aa1a4e-f257-4250-9023-f9fda8bf2987 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:03.415703 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67aa1a4e-f257-4250-9023-f9fda8bf2987 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:03.416384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67aa1a4e-f257-4250-9023-f9fda8bf2987 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:03.552815 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-67aa1a4e-f257-4250-9023-f9fda8bf2987 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:03.555302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:03.561633 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-67aa1a4e-f257-4250-9023-f9fda8bf2987 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1370 microversion: 2.1 time: 0.162871 Jul 04 09:23:03.562208 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 291/567] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:03 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:04.055830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-33ef04ee-6ec5-4dd0-a889-480c5dfaf9f2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:04.056449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-33ef04ee-6ec5-4dd0-a889-480c5dfaf9f2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:04.058326 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=4 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:04.064543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-33ef04ee-6ec5-4dd0-a889-480c5dfaf9f2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.064990 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-33ef04ee-6ec5-4dd0-a889-480c5dfaf9f2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.065774 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-33ef04ee-6ec5-4dd0-a889-480c5dfaf9f2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.066219 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-33ef04ee-6ec5-4dd0-a889-480c5dfaf9f2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.198424 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-33ef04ee-6ec5-4dd0-a889-480c5dfaf9f2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:04.206942 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-33ef04ee-6ec5-4dd0-a889-480c5dfaf9f2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1365 microversion: 2.1 time: 0.154903 Jul 04 09:23:04.207556 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 277/568] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:04 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:04.431030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-87fa8a74-8cb7-4238-aa93-722f0f4e511a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:04.431644 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-87fa8a74-8cb7-4238-aa93-722f0f4e511a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:04.433791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=4 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:04.434431 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=20 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:04.441611 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87fa8a74-8cb7-4238-aa93-722f0f4e511a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.442067 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87fa8a74-8cb7-4238-aa93-722f0f4e511a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.442829 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87fa8a74-8cb7-4238-aa93-722f0f4e511a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.443268 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-87fa8a74-8cb7-4238-aa93-722f0f4e511a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.574144 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-87fa8a74-8cb7-4238-aa93-722f0f4e511a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:04.579063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ede8d77b-a7ad-442a-9dcc-7cf32d8dc8a1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:04.579860 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ede8d77b-a7ad-442a-9dcc-7cf32d8dc8a1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:04.582296 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-87fa8a74-8cb7-4238-aa93-722f0f4e511a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1679 microversion: 2.1 time: 0.155092 Jul 04 09:23:04.583060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 292/569] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:04 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:04.586643 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ede8d77b-a7ad-442a-9dcc-7cf32d8dc8a1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.587126 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ede8d77b-a7ad-442a-9dcc-7cf32d8dc8a1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.587896 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ede8d77b-a7ad-442a-9dcc-7cf32d8dc8a1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.588335 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ede8d77b-a7ad-442a-9dcc-7cf32d8dc8a1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.728795 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ede8d77b-a7ad-442a-9dcc-7cf32d8dc8a1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:04.740421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ede8d77b-a7ad-442a-9dcc-7cf32d8dc8a1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1564 microversion: 2.1 time: 0.165751 Jul 04 09:23:04.741013 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 278/570] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:04 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:04.751437 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-e6079883-ab24-4ac1-8604-ca2c19687603 req-e18bab81-2f96-4ce2-82b3-bb26bccbe523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63068e8d-61aa-4db4-aa29-b3b179933ba9", "name": "network-vif-plugged", "status": "completed", "tag": "6bbe12ec-8feb-466a-93b3-661859e34233"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:04.760772 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f52101a5-5140-47a1-bda4-93fa4917a3a4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:04.760912 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e6079883-ab24-4ac1-8604-ca2c19687603 req-e18bab81-2f96-4ce2-82b3-bb26bccbe523 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.761211 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e6079883-ab24-4ac1-8604-ca2c19687603 req-e18bab81-2f96-4ce2-82b3-bb26bccbe523 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.761836 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f52101a5-5140-47a1-bda4-93fa4917a3a4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:04.770432 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f52101a5-5140-47a1-bda4-93fa4917a3a4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.770914 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f52101a5-5140-47a1-bda4-93fa4917a3a4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.772954 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-e6079883-ab24-4ac1-8604-ca2c19687603 req-e18bab81-2f96-4ce2-82b3-bb26bccbe523 service nova] Creating event network-vif-plugged:6bbe12ec-8feb-466a-93b3-661859e34233 for instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 on hv-cinder-84456 Jul 04 09:23:04.773099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f52101a5-5140-47a1-bda4-93fa4917a3a4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:04.773436 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f52101a5-5140-47a1-bda4-93fa4917a3a4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:04.777837 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-e6079883-ab24-4ac1-8604-ca2c19687603 req-e18bab81-2f96-4ce2-82b3-bb26bccbe523 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033880 Jul 04 09:23:04.779140 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 293/571] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:04.876219 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f52101a5-5140-47a1-bda4-93fa4917a3a4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122254 Jul 04 09:23:04.877519 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 279/572] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 4 09:23:04 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:23:05.225522 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b2ef32a1-7cb6-43f3-a82a-35d0ea7b303e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:05.226248 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b2ef32a1-7cb6-43f3-a82a-35d0ea7b303e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:05.233230 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2ef32a1-7cb6-43f3-a82a-35d0ea7b303e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.233781 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2ef32a1-7cb6-43f3-a82a-35d0ea7b303e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.234573 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2ef32a1-7cb6-43f3-a82a-35d0ea7b303e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.235029 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2ef32a1-7cb6-43f3-a82a-35d0ea7b303e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.373460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b2ef32a1-7cb6-43f3-a82a-35d0ea7b303e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:05.380959 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b2ef32a1-7cb6-43f3-a82a-35d0ea7b303e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1365 microversion: 2.1 time: 0.159982 Jul 04 09:23:05.381687 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 294/573] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:05 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:05.600247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-64b59dd1-fc15-4814-bd75-13c9f6af3796 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:05.600867 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-64b59dd1-fc15-4814-bd75-13c9f6af3796 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:05.606944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-64b59dd1-fc15-4814-bd75-13c9f6af3796 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.607411 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-64b59dd1-fc15-4814-bd75-13c9f6af3796 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.608189 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-64b59dd1-fc15-4814-bd75-13c9f6af3796 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.608634 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-64b59dd1-fc15-4814-bd75-13c9f6af3796 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.744702 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-64b59dd1-fc15-4814-bd75-13c9f6af3796 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:05.753738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-64b59dd1-fc15-4814-bd75-13c9f6af3796 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1656 microversion: 2.1 time: 0.157825 Jul 04 09:23:05.754317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 280/574] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:05 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:05.771574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cc7e8fdc-8035-4a66-8f5f-4fcbbb6968ce tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:05.779182 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cc7e8fdc-8035-4a66-8f5f-4fcbbb6968ce tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.779623 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cc7e8fdc-8035-4a66-8f5f-4fcbbb6968ce tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.801889 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cc7e8fdc-8035-4a66-8f5f-4fcbbb6968ce tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Going to try to start instance {{(pid=117664) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 09:23:05.847414 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cc7e8fdc-8035-4a66-8f5f-4fcbbb6968ce tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/action" status: 202 len: 0 microversion: 2.1 time: 0.079513 Jul 04 09:23:05.848025 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 295/575] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:23:05 2022] POST /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:23:05.856218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ddfaa5aa-c40d-40cd-840b-507ed312b8c5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:05.858368 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ddfaa5aa-c40d-40cd-840b-507ed312b8c5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:05.870852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ddfaa5aa-c40d-40cd-840b-507ed312b8c5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.871622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ddfaa5aa-c40d-40cd-840b-507ed312b8c5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.873385 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ddfaa5aa-c40d-40cd-840b-507ed312b8c5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.874031 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ddfaa5aa-c40d-40cd-840b-507ed312b8c5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.904976 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-8ecb749b-964e-4f9c-9c6e-305fe3de1844 req-c6a04b8a-6cf0-4a91-a87c-cddb9206dca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80be812b-a9c3-4327-b55b-0dbcf97a12c7", "tag": "57ace4f7-2cc2-4fa1-b912-fdb4c747abf3"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:05.914092 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8ecb749b-964e-4f9c-9c6e-305fe3de1844 req-c6a04b8a-6cf0-4a91-a87c-cddb9206dca8 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:05.914591 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8ecb749b-964e-4f9c-9c6e-305fe3de1844 req-c6a04b8a-6cf0-4a91-a87c-cddb9206dca8 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:05.928880 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-8ecb749b-964e-4f9c-9c6e-305fe3de1844 req-c6a04b8a-6cf0-4a91-a87c-cddb9206dca8 service nova] Creating event network-changed:57ace4f7-2cc2-4fa1-b912-fdb4c747abf3 for instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 on hv-cinder-84456 Jul 04 09:23:05.934398 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-8ecb749b-964e-4f9c-9c6e-305fe3de1844 req-c6a04b8a-6cf0-4a91-a87c-cddb9206dca8 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034963 Jul 04 09:23:05.935924 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 296/576] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:06.020567 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ddfaa5aa-c40d-40cd-840b-507ed312b8c5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:06.029667 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ddfaa5aa-c40d-40cd-840b-507ed312b8c5 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1665 microversion: 2.1 time: 0.177203 Jul 04 09:23:06.030474 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 281/577] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:05 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:06.399282 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d45e7a83-1ef9-43d0-b4a5-5f31727b47f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:06.399993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d45e7a83-1ef9-43d0-b4a5-5f31727b47f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:06.406928 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d45e7a83-1ef9-43d0-b4a5-5f31727b47f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:06.407472 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d45e7a83-1ef9-43d0-b4a5-5f31727b47f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:06.408386 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d45e7a83-1ef9-43d0-b4a5-5f31727b47f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:06.408872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d45e7a83-1ef9-43d0-b4a5-5f31727b47f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:06.546159 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d45e7a83-1ef9-43d0-b4a5-5f31727b47f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:06.553609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d45e7a83-1ef9-43d0-b4a5-5f31727b47f1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1365 microversion: 2.1 time: 0.158555 Jul 04 09:23:06.554177 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 297/578] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:06 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:07.049515 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ef3f10cd-f453-4c83-a8a0-72c433229b6d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:07.050832 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ef3f10cd-f453-4c83-a8a0-72c433229b6d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:07.058527 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef3f10cd-f453-4c83-a8a0-72c433229b6d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:07.058991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef3f10cd-f453-4c83-a8a0-72c433229b6d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:07.060014 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef3f10cd-f453-4c83-a8a0-72c433229b6d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:07.060763 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef3f10cd-f453-4c83-a8a0-72c433229b6d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:07.199736 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ef3f10cd-f453-4c83-a8a0-72c433229b6d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:07.207414 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ef3f10cd-f453-4c83-a8a0-72c433229b6d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1665 microversion: 2.1 time: 0.163933 Jul 04 09:23:07.208334 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 282/579] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:07 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:07.571923 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b42ae866-6a22-48c9-94eb-068a38470cc8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:07.572658 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b42ae866-6a22-48c9-94eb-068a38470cc8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:07.580176 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b42ae866-6a22-48c9-94eb-068a38470cc8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:07.580734 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b42ae866-6a22-48c9-94eb-068a38470cc8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:07.581618 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b42ae866-6a22-48c9-94eb-068a38470cc8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:07.582060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b42ae866-6a22-48c9-94eb-068a38470cc8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:07.723565 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b42ae866-6a22-48c9-94eb-068a38470cc8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:07.731008 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b42ae866-6a22-48c9-94eb-068a38470cc8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1555 microversion: 2.1 time: 0.164014 Jul 04 09:23:07.731631 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 298/580] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:07 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:07.748425 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-be1c4fe7-3e16-44ae-9dfa-68ea87ec4f82 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:07.748924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-be1c4fe7-3e16-44ae-9dfa-68ea87ec4f82 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:07.755105 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be1c4fe7-3e16-44ae-9dfa-68ea87ec4f82 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:07.755562 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be1c4fe7-3e16-44ae-9dfa-68ea87ec4f82 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:07.756332 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be1c4fe7-3e16-44ae-9dfa-68ea87ec4f82 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:07.756775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-be1c4fe7-3e16-44ae-9dfa-68ea87ec4f82 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:07.760445 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:07.835337 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-be1c4fe7-3e16-44ae-9dfa-68ea87ec4f82 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091219 Jul 04 09:23:07.835942 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 283/581] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 4 09:23:07 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:08.225560 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bf9dc489-b168-446d-8173-c953b635acde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:08.226126 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bf9dc489-b168-446d-8173-c953b635acde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:08.232959 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bf9dc489-b168-446d-8173-c953b635acde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:08.233448 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bf9dc489-b168-446d-8173-c953b635acde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:08.234265 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bf9dc489-b168-446d-8173-c953b635acde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:08.234660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bf9dc489-b168-446d-8173-c953b635acde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:08.453692 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bf9dc489-b168-446d-8173-c953b635acde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:08.461795 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bf9dc489-b168-446d-8173-c953b635acde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1665 microversion: 2.1 time: 0.240110 Jul 04 09:23:08.462460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 299/582] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:08 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1665 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:08.996383 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-acee5464-2eb0-4de1-bae7-350ed65dd83d req-57a56069-c7a3-4b9f-8ab5-065f9068a0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63068e8d-61aa-4db4-aa29-b3b179933ba9", "tag": "6bbe12ec-8feb-466a-93b3-661859e34233"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:09.005269 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-acee5464-2eb0-4de1-bae7-350ed65dd83d req-57a56069-c7a3-4b9f-8ab5-065f9068a0c9 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:09.005807 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-acee5464-2eb0-4de1-bae7-350ed65dd83d req-57a56069-c7a3-4b9f-8ab5-065f9068a0c9 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:09.017439 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-acee5464-2eb0-4de1-bae7-350ed65dd83d req-57a56069-c7a3-4b9f-8ab5-065f9068a0c9 service nova] Creating event network-changed:6bbe12ec-8feb-466a-93b3-661859e34233 for instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 on hv-cinder-84456 Jul 04 09:23:09.023143 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-acee5464-2eb0-4de1-bae7-350ed65dd83d req-57a56069-c7a3-4b9f-8ab5-065f9068a0c9 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030955 Jul 04 09:23:09.024030 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 284/583] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:09.479747 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1606f3c0-601d-443e-93f5-c3e415d42b01 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:09.480387 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1606f3c0-601d-443e-93f5-c3e415d42b01 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:09.487715 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1606f3c0-601d-443e-93f5-c3e415d42b01 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:09.488164 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1606f3c0-601d-443e-93f5-c3e415d42b01 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:09.488928 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1606f3c0-601d-443e-93f5-c3e415d42b01 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:09.489391 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1606f3c0-601d-443e-93f5-c3e415d42b01 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:09.647893 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1606f3c0-601d-443e-93f5-c3e415d42b01 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:09.657548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1606f3c0-601d-443e-93f5-c3e415d42b01 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1669 microversion: 2.1 time: 0.181616 Jul 04 09:23:09.658264 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 300/584] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:09 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1669 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:20.860165 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=25 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:20.860833 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=5 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:20.866262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0602a858-7c1b-46a6-84ca-279be0e67aa5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:20.867078 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0602a858-7c1b-46a6-84ca-279be0e67aa5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:20.874779 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0602a858-7c1b-46a6-84ca-279be0e67aa5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:20.875334 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0602a858-7c1b-46a6-84ca-279be0e67aa5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:20.876385 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0602a858-7c1b-46a6-84ca-279be0e67aa5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:20.876905 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0602a858-7c1b-46a6-84ca-279be0e67aa5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:20.907037 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0602a858-7c1b-46a6-84ca-279be0e67aa5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-volume_attachments/84050e97-d917-43ad-b3b5-182f8b33715e" status: 200 len: 194 microversion: 2.20 time: 0.048705 Jul 04 09:23:20.907612 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 285/585] 10.222.0.71 () {60 vars in 1453 bytes} [Mon Jul 4 09:23:20 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-volume_attachments/84050e97-d917-43ad-b3b5-182f8b33715e => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:23:20.970743 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0bdb55c4-e32f-437d-b90a-cc602f13799f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:20.971261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0bdb55c4-e32f-437d-b90a-cc602f13799f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:20.974077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:20.974736 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:20.980691 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bdb55c4-e32f-437d-b90a-cc602f13799f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:20.981179 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bdb55c4-e32f-437d-b90a-cc602f13799f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:20.981966 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bdb55c4-e32f-437d-b90a-cc602f13799f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:20.982642 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bdb55c4-e32f-437d-b90a-cc602f13799f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:21.062795 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-0bdb55c4-e32f-437d-b90a-cc602f13799f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lazy-loading 'services' on Instance uuid 9a8dcc08-23ef-46ee-b941-55a7f1716d41 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:23:21.132456 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0bdb55c4-e32f-437d-b90a-cc602f13799f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "DELETE /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-volume_attachments/84050e97-d917-43ad-b3b5-182f8b33715e" status: 202 len: 0 microversion: 2.20 time: 0.166276 Jul 04 09:23:21.133081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 301/586] 10.222.0.71 () {60 vars in 1456 bytes} [Mon Jul 4 09:23:20 2022] DELETE /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-volume_attachments/84050e97-d917-43ad-b3b5-182f8b33715e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:23:21.142084 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f4035755-f667-494b-ac41-9e8e8de52acd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:21.143209 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f4035755-f667-494b-ac41-9e8e8de52acd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:21.149308 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f4035755-f667-494b-ac41-9e8e8de52acd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:21.149764 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f4035755-f667-494b-ac41-9e8e8de52acd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:21.150536 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f4035755-f667-494b-ac41-9e8e8de52acd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:21.150977 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f4035755-f667-494b-ac41-9e8e8de52acd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:21.180829 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f4035755-f667-494b-ac41-9e8e8de52acd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043364 Jul 04 09:23:21.181623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 286/587] 10.222.0.71 () {60 vars in 1342 bytes} [Mon Jul 4 09:23:21 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:23:22.193181 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9ca9cfcb-fc8d-4ce4-a7f7-5758b1606ac2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:22.194268 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9ca9cfcb-fc8d-4ce4-a7f7-5758b1606ac2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:22.200664 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ca9cfcb-fc8d-4ce4-a7f7-5758b1606ac2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:22.201714 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ca9cfcb-fc8d-4ce4-a7f7-5758b1606ac2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:22.202487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ca9cfcb-fc8d-4ce4-a7f7-5758b1606ac2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:22.202920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9ca9cfcb-fc8d-4ce4-a7f7-5758b1606ac2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:22.233768 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9ca9cfcb-fc8d-4ce4-a7f7-5758b1606ac2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045518 Jul 04 09:23:22.234314 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 302/588] 10.222.0.71 () {60 vars in 1342 bytes} [Mon Jul 4 09:23:22 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:22.292760 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-eb8affe5-5940-4655-a8eb-7f0fcf6ad34a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:22.293432 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-eb8affe5-5940-4655-a8eb-7f0fcf6ad34a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:22.300671 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb8affe5-5940-4655-a8eb-7f0fcf6ad34a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:22.301154 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb8affe5-5940-4655-a8eb-7f0fcf6ad34a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:22.301914 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb8affe5-5940-4655-a8eb-7f0fcf6ad34a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:22.302353 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eb8affe5-5940-4655-a8eb-7f0fcf6ad34a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:22.327338 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-eb8affe5-5940-4655-a8eb-7f0fcf6ad34a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:23:22.401314 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-eb8affe5-5940-4655-a8eb-7f0fcf6ad34a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "DELETE /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 204 len: 0 microversion: 2.20 time: 0.112135 Jul 04 09:23:22.401933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 287/589] 10.222.0.71 () {60 vars in 1279 bytes} [Mon Jul 4 09:23:22 2022] DELETE /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 09:23:22.410956 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-53e1cb17-c7aa-4c3d-adbb-0e8256fc6dcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:22.411567 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-53e1cb17-c7aa-4c3d-adbb-0e8256fc6dcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:22.417733 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-53e1cb17-c7aa-4c3d-adbb-0e8256fc6dcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:22.418189 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-53e1cb17-c7aa-4c3d-adbb-0e8256fc6dcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:22.418952 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-53e1cb17-c7aa-4c3d-adbb-0e8256fc6dcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:22.419437 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-53e1cb17-c7aa-4c3d-adbb-0e8256fc6dcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:22.546714 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-53e1cb17-c7aa-4c3d-adbb-0e8256fc6dcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:22.554636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-53e1cb17-c7aa-4c3d-adbb-0e8256fc6dcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:22.556142 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-53e1cb17-c7aa-4c3d-adbb-0e8256fc6dcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:22.557314 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-53e1cb17-c7aa-4c3d-adbb-0e8256fc6dcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.150230 Jul 04 09:23:22.557869 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 303/590] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:22 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:23.576883 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-124c4128-e6dc-4a8b-9d9e-f3c843e2a6ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:23.577621 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-124c4128-e6dc-4a8b-9d9e-f3c843e2a6ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:23.584053 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-124c4128-e6dc-4a8b-9d9e-f3c843e2a6ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:23.585165 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-124c4128-e6dc-4a8b-9d9e-f3c843e2a6ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:23.585980 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-124c4128-e6dc-4a8b-9d9e-f3c843e2a6ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:23.586425 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-124c4128-e6dc-4a8b-9d9e-f3c843e2a6ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:23.720327 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-124c4128-e6dc-4a8b-9d9e-f3c843e2a6ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:23.728508 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-124c4128-e6dc-4a8b-9d9e-f3c843e2a6ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:23.730346 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-124c4128-e6dc-4a8b-9d9e-f3c843e2a6ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:23.731715 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-124c4128-e6dc-4a8b-9d9e-f3c843e2a6ec tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.159649 Jul 04 09:23:23.732352 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 288/591] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:23 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:24.752174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-083d4568-8ec9-4be3-ae54-7779b496f47e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:24.754126 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-083d4568-8ec9-4be3-ae54-7779b496f47e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:24.761931 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-083d4568-8ec9-4be3-ae54-7779b496f47e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:24.762387 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-083d4568-8ec9-4be3-ae54-7779b496f47e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:24.763226 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-083d4568-8ec9-4be3-ae54-7779b496f47e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:24.764056 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-083d4568-8ec9-4be3-ae54-7779b496f47e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:25.022730 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-083d4568-8ec9-4be3-ae54-7779b496f47e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:25.033206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-083d4568-8ec9-4be3-ae54-7779b496f47e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:25.035465 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-083d4568-8ec9-4be3-ae54-7779b496f47e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:25.037341 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-083d4568-8ec9-4be3-ae54-7779b496f47e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1724 microversion: 2.20 time: 0.290412 Jul 04 09:23:25.048916 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 304/592] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:24 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:23:25.471810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-aa19685c-f6ab-4c18-bc56-f36b9a45e104 req-c1ac2a5b-57f4-4f67-bd78-75457978c1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8dcc08-23ef-46ee-b941-55a7f1716d41", "name": "network-vif-deleted", "tag": "170feb05-63b9-496e-b589-498558ed153c"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:25.490065 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-aa19685c-f6ab-4c18-bc56-f36b9a45e104 req-c1ac2a5b-57f4-4f67-bd78-75457978c1ca service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:25.490574 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-aa19685c-f6ab-4c18-bc56-f36b9a45e104 req-c1ac2a5b-57f4-4f67-bd78-75457978c1ca service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:25.519435 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-aa19685c-f6ab-4c18-bc56-f36b9a45e104 req-c1ac2a5b-57f4-4f67-bd78-75457978c1ca service nova] Creating event network-vif-deleted:170feb05-63b9-496e-b589-498558ed153c for instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 on hv-cinder-84456 Jul 04 09:23:25.525395 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-aa19685c-f6ab-4c18-bc56-f36b9a45e104 req-c1ac2a5b-57f4-4f67-bd78-75457978c1ca service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068891 Jul 04 09:23:25.528417 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 289/593] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:26.058470 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:26.059087 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:26.069852 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:26.070234 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:26.071198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:26.071927 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:26.119444 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:26.120172 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:26.121831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lazy-loading 'fault' on Instance uuid 9a8dcc08-23ef-46ee-b941-55a7f1716d41 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:23:26.199885 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:26.212033 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:26.213955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:26.215390 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e9cacc16-c123-4989-87f7-041157ef601c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 200 len: 1371 microversion: 2.20 time: 0.163110 Jul 04 09:23:26.226644 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 305/594] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:26 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:27.235137 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3c5b43ea-335e-4b11-9fb5-229e1dd0cbe5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:27.236867 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3c5b43ea-335e-4b11-9fb5-229e1dd0cbe5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:27.244200 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c5b43ea-335e-4b11-9fb5-229e1dd0cbe5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:27.245007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c5b43ea-335e-4b11-9fb5-229e1dd0cbe5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:27.246168 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c5b43ea-335e-4b11-9fb5-229e1dd0cbe5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:27.246833 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c5b43ea-335e-4b11-9fb5-229e1dd0cbe5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:27.269156 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-3c5b43ea-335e-4b11-9fb5-229e1dd0cbe5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] HTTP exception thrown: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3c5b43ea-335e-4b11-9fb5-229e1dd0cbe5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Request method failure captured: Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 HTTP/1.1 Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCURe4wv-78P3gNJpGH87weBJlWBg3Ig9MzVuBXj6WW5IX9ko9achBNRIM6Gjn9W6c2uNBaq-kZkWmqYh9U_LeD2uF6LGdzRKdgkZpRcniYqSoRtBtrj2GWu1P6bWthexDX87zLjlHH8FGOtckrXrJIf137m1dl8wHCgcDQKevONKM Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:23:27.271275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_83d33ddd4b124161aba270998b7d2462", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 60d06d081a29460b8e85b0b301399f08 Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:23:27.272719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '9a8dcc08-23ef-46ee-b941-55a7f1716d41'} Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:23:27.273525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:23:27.274773 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:23:27.277673 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3c5b43ea-335e-4b11-9fb5-229e1dd0cbe5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Returning 404 to user: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:23:27.278912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3c5b43ea-335e-4b11-9fb5-229e1dd0cbe5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 404 len: 111 microversion: 2.20 time: 0.048074 Jul 04 09:23:27.283312 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 290/595] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:27 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:23:27.290527 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8f989b82-5524-44cc-ab70-a08dcfc04356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '.version_select at 0x7fad7ab0c430>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:27.315668 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8f989b82-5524-44cc-ab70-a08dcfc04356 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811039041" status: 204 len: 0 microversion: 2.20 time: 0.030422 Jul 04 09:23:27.317263 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 306/596] 10.222.0.71 () {60 vars in 1258 bytes} [Mon Jul 4 09:23:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811039041 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 04 09:23:28.109301 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-28253e40-53c8-41cf-bb11-022e3081f61b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Action: 'create', calling method: .version_select at 0x7fad7aab8f70>, body: {"keypair": {"name": "tempest-keypair-1552564425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEy0dpUmk+tcqIWFCSdlV3VdsyTq+aLjOouZbOUfTY8lvLxQz1eicAOw2Qvh1KvUATtk4QSjLumIHdL6n/yrPqWy4bGOJ429ao17c1SDPcuvFbwuYRFh7gAlvWLnt7e3dw=="}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:28.125467 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-28253e40-53c8-41cf-bb11-022e3081f61b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Getting quotas for project 83d33ddd4b124161aba270998b7d2462. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:23:28.129537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-28253e40-53c8-41cf-bb11-022e3081f61b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Getting quotas for user 60d06d081a29460b8e85b0b301399f08 and project 83d33ddd4b124161aba270998b7d2462. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:23:28.168269 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-28253e40-53c8-41cf-bb11-022e3081f61b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052793 Jul 04 09:23:28.183591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 291/597] 10.222.0.71 () {62 vars in 1199 bytes} [Mon Jul 4 09:23:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 04 09:23:29.853531 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1979826855", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da66c86d-f254-4d81-9f76-9ccab5e05cc2"}], "security_groups": [{"name": "tempest-securitygroup--1015363409"}], "key_name": "tempest-keypair-1552564425", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:29.981115 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] validate_networks() for [('da66c86d-f254-4d81-9f76-9ccab5e05cc2', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:23:30.475671 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:23:30.476107 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:23:30.476592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:23:30.477136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:23:30.477488 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:23:30.488053 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:30.488681 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:30.489753 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:30.492501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:30.518918 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Getting quotas for project 83d33ddd4b124161aba270998b7d2462. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:23:30.524071 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Getting quotas for user 60d06d081a29460b8e85b0b301399f08 and project 83d33ddd4b124161aba270998b7d2462. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:23:30.540458 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:23:30.547712 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:23:30.651381 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3a5eca94-45ec-4a92-9415-cef04708d1cc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.814049 Jul 04 09:23:30.652079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 307/598] 10.222.0.71 () {62 vars in 1187 bytes} [Mon Jul 4 09:23:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 04 09:23:30.666372 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e20d734a-2d10-4c32-8b6e-f6013460122c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:30.667672 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e20d734a-2d10-4c32-8b6e-f6013460122c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:30.761259 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e20d734a-2d10-4c32-8b6e-f6013460122c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:30.778143 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e20d734a-2d10-4c32-8b6e-f6013460122c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:30.782371 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e20d734a-2d10-4c32-8b6e-f6013460122c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:30.786140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e20d734a-2d10-4c32-8b6e-f6013460122c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1282 microversion: 2.20 time: 0.125402 Jul 04 09:23:30.790740 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 292/599] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:30 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1282 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:31.805886 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1d204311-9883-4fac-8967-b839670a8a73 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:31.807181 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1d204311-9883-4fac-8967-b839670a8a73 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:31.815161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1d204311-9883-4fac-8967-b839670a8a73 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:31.815692 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1d204311-9883-4fac-8967-b839670a8a73 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:31.817204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1d204311-9883-4fac-8967-b839670a8a73 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:31.817204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1d204311-9883-4fac-8967-b839670a8a73 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:31.907369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1d204311-9883-4fac-8967-b839670a8a73 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:31.920257 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1d204311-9883-4fac-8967-b839670a8a73 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:31.922218 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1d204311-9883-4fac-8967-b839670a8a73 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:31.924050 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1d204311-9883-4fac-8967-b839670a8a73 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1342 microversion: 2.20 time: 0.122473 Jul 04 09:23:31.935924 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 308/600] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:31 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1342 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:32.942516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b3dc0d22-afff-4de2-86f1-d08540510b0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:32.943280 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b3dc0d22-afff-4de2-86f1-d08540510b0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:32.952831 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3dc0d22-afff-4de2-86f1-d08540510b0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:32.953321 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3dc0d22-afff-4de2-86f1-d08540510b0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:32.960243 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3dc0d22-afff-4de2-86f1-d08540510b0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:32.961072 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b3dc0d22-afff-4de2-86f1-d08540510b0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:33.119355 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b3dc0d22-afff-4de2-86f1-d08540510b0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:33.136134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b3dc0d22-afff-4de2-86f1-d08540510b0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:33.141349 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b3dc0d22-afff-4de2-86f1-d08540510b0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:33.145677 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b3dc0d22-afff-4de2-86f1-d08540510b0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1340 microversion: 2.20 time: 0.207066 Jul 04 09:23:33.149260 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 293/601] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:32 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1340 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:34.166807 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-98d03d83-c5c3-41e4-9bec-1de9caf6ee8f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:34.168379 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-98d03d83-c5c3-41e4-9bec-1de9caf6ee8f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:34.179277 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-98d03d83-c5c3-41e4-9bec-1de9caf6ee8f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:34.182840 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-98d03d83-c5c3-41e4-9bec-1de9caf6ee8f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:34.190248 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-98d03d83-c5c3-41e4-9bec-1de9caf6ee8f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:34.190832 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-98d03d83-c5c3-41e4-9bec-1de9caf6ee8f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:34.328469 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-e2c9beb6-72aa-48b6-ac71-63028dac2f2f req-da1b8d68-c907-47d7-afe0-c260c5e17a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1af165-f9ff-409d-a80d-0998b4f545d9", "tag": "a2d58751-fbe0-49d6-b04c-2629ea26d8f4"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:34.345203 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-e2c9beb6-72aa-48b6-ac71-63028dac2f2f req-da1b8d68-c907-47d7-afe0-c260c5e17a4a service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:34.345658 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-e2c9beb6-72aa-48b6-ac71-63028dac2f2f req-da1b8d68-c907-47d7-afe0-c260c5e17a4a service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:34.361473 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-e2c9beb6-72aa-48b6-ac71-63028dac2f2f req-da1b8d68-c907-47d7-afe0-c260c5e17a4a service nova] Creating event network-changed:a2d58751-fbe0-49d6-b04c-2629ea26d8f4 for instance fc1af165-f9ff-409d-a80d-0998b4f545d9 on hv-cinder-84456 Jul 04 09:23:34.368880 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-e2c9beb6-72aa-48b6-ac71-63028dac2f2f req-da1b8d68-c907-47d7-afe0-c260c5e17a4a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048863 Jul 04 09:23:34.376112 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 294/602] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:23:34.580776 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-98d03d83-c5c3-41e4-9bec-1de9caf6ee8f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:34.594600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-98d03d83-c5c3-41e4-9bec-1de9caf6ee8f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:34.598448 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-98d03d83-c5c3-41e4-9bec-1de9caf6ee8f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:34.601562 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-98d03d83-c5c3-41e4-9bec-1de9caf6ee8f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1408 microversion: 2.20 time: 0.440888 Jul 04 09:23:34.604473 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 309/603] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:34 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1408 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:35.624396 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3aca7e96-f21f-4bee-aa7f-3a44dc8bec78 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:35.626876 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3aca7e96-f21f-4bee-aa7f-3a44dc8bec78 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:35.661930 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3aca7e96-f21f-4bee-aa7f-3a44dc8bec78 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:35.665503 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3aca7e96-f21f-4bee-aa7f-3a44dc8bec78 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:35.666630 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3aca7e96-f21f-4bee-aa7f-3a44dc8bec78 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:35.669814 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3aca7e96-f21f-4bee-aa7f-3a44dc8bec78 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:35.873548 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3aca7e96-f21f-4bee-aa7f-3a44dc8bec78 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:35.890494 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3aca7e96-f21f-4bee-aa7f-3a44dc8bec78 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:35.893278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3aca7e96-f21f-4bee-aa7f-3a44dc8bec78 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:35.894665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3aca7e96-f21f-4bee-aa7f-3a44dc8bec78 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1408 microversion: 2.20 time: 0.276330 Jul 04 09:23:35.900218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 295/604] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:35 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:36.926124 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a2bbb13a-f726-449d-97d8-b8212b0b862a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:36.927260 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a2bbb13a-f726-449d-97d8-b8212b0b862a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:36.938402 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a2bbb13a-f726-449d-97d8-b8212b0b862a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:36.938874 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a2bbb13a-f726-449d-97d8-b8212b0b862a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:36.939672 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a2bbb13a-f726-449d-97d8-b8212b0b862a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:36.940115 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a2bbb13a-f726-449d-97d8-b8212b0b862a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:37.093130 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a2bbb13a-f726-449d-97d8-b8212b0b862a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:37.101348 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a2bbb13a-f726-449d-97d8-b8212b0b862a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:37.103235 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-a2bbb13a-f726-449d-97d8-b8212b0b862a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:37.104346 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a2bbb13a-f726-449d-97d8-b8212b0b862a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1408 microversion: 2.20 time: 0.187601 Jul 04 09:23:37.105159 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 310/605] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:36 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:38.127305 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0626930f-bb47-4390-ae61-0a5c926007ae tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:38.128826 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0626930f-bb47-4390-ae61-0a5c926007ae tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:38.137261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0626930f-bb47-4390-ae61-0a5c926007ae tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:38.138798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0626930f-bb47-4390-ae61-0a5c926007ae tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:38.139684 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0626930f-bb47-4390-ae61-0a5c926007ae tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:38.140357 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0626930f-bb47-4390-ae61-0a5c926007ae tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:38.303043 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0626930f-bb47-4390-ae61-0a5c926007ae tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:38.314370 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0626930f-bb47-4390-ae61-0a5c926007ae tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:38.316308 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0626930f-bb47-4390-ae61-0a5c926007ae tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:38.317724 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0626930f-bb47-4390-ae61-0a5c926007ae tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1408 microversion: 2.20 time: 0.195488 Jul 04 09:23:38.328551 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 296/606] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:38 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:39.346265 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7faedb47-f2dd-445b-9169-dd9f5d4c52a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:39.346899 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7faedb47-f2dd-445b-9169-dd9f5d4c52a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:39.359800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7faedb47-f2dd-445b-9169-dd9f5d4c52a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:39.361970 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7faedb47-f2dd-445b-9169-dd9f5d4c52a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:39.363164 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7faedb47-f2dd-445b-9169-dd9f5d4c52a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:39.363771 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7faedb47-f2dd-445b-9169-dd9f5d4c52a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:39.586682 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7faedb47-f2dd-445b-9169-dd9f5d4c52a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:39.598612 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7faedb47-f2dd-445b-9169-dd9f5d4c52a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:39.601029 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7faedb47-f2dd-445b-9169-dd9f5d4c52a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:39.602640 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7faedb47-f2dd-445b-9169-dd9f5d4c52a5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1408 microversion: 2.20 time: 0.270345 Jul 04 09:23:39.603690 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 311/607] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:39 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:40.625876 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a9d1d0bb-5318-4d2c-8489-e408d328dcab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:40.626482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a9d1d0bb-5318-4d2c-8489-e408d328dcab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:40.633648 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9d1d0bb-5318-4d2c-8489-e408d328dcab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:40.634275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9d1d0bb-5318-4d2c-8489-e408d328dcab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:40.635298 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9d1d0bb-5318-4d2c-8489-e408d328dcab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:40.635943 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9d1d0bb-5318-4d2c-8489-e408d328dcab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:40.767438 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:40.790328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a9d1d0bb-5318-4d2c-8489-e408d328dcab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:40.799253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a9d1d0bb-5318-4d2c-8489-e408d328dcab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:40.803702 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a9d1d0bb-5318-4d2c-8489-e408d328dcab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:40.805596 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a9d1d0bb-5318-4d2c-8489-e408d328dcab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1408 microversion: 2.20 time: 0.184501 Jul 04 09:23:40.809416 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 297/608] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:40 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:40.925859 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-9c0a41ca-1a54-4161-b3bd-fdfedc09f7c1 req-5be603eb-84e6-4c01-94e9-05da84a61575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1af165-f9ff-409d-a80d-0998b4f545d9", "name": "network-vif-plugged", "status": "completed", "tag": "a2d58751-fbe0-49d6-b04c-2629ea26d8f4"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:40.935252 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:40.936467 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:40.942977 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-9c0a41ca-1a54-4161-b3bd-fdfedc09f7c1 req-5be603eb-84e6-4c01-94e9-05da84a61575 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:40.944238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-9c0a41ca-1a54-4161-b3bd-fdfedc09f7c1 req-5be603eb-84e6-4c01-94e9-05da84a61575 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:40.962079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-9c0a41ca-1a54-4161-b3bd-fdfedc09f7c1 req-5be603eb-84e6-4c01-94e9-05da84a61575 service nova] Creating event network-vif-plugged:a2d58751-fbe0-49d6-b04c-2629ea26d8f4 for instance fc1af165-f9ff-409d-a80d-0998b4f545d9 on hv-cinder-84456 Jul 04 09:23:40.973655 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-9c0a41ca-1a54-4161-b3bd-fdfedc09f7c1 req-5be603eb-84e6-4c01-94e9-05da84a61575 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051657 Jul 04 09:23:40.974578 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 312/609] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:41.823753 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5750d3d4-7b77-4e29-b1b1-c7747d2ce780 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:41.825101 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5750d3d4-7b77-4e29-b1b1-c7747d2ce780 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:41.832144 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5750d3d4-7b77-4e29-b1b1-c7747d2ce780 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:41.832898 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5750d3d4-7b77-4e29-b1b1-c7747d2ce780 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:41.834193 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5750d3d4-7b77-4e29-b1b1-c7747d2ce780 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:41.834193 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5750d3d4-7b77-4e29-b1b1-c7747d2ce780 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:41.978352 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5750d3d4-7b77-4e29-b1b1-c7747d2ce780 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:41.987951 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5750d3d4-7b77-4e29-b1b1-c7747d2ce780 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:41.989656 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5750d3d4-7b77-4e29-b1b1-c7747d2ce780 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:41.990971 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5750d3d4-7b77-4e29-b1b1-c7747d2ce780 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1408 microversion: 2.20 time: 0.171231 Jul 04 09:23:41.991539 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 298/610] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:41 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:43.011760 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4d5f4d3c-267b-48a0-9dac-a9bc7c43d7c4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:43.012494 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4d5f4d3c-267b-48a0-9dac-a9bc7c43d7c4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:43.019255 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4d5f4d3c-267b-48a0-9dac-a9bc7c43d7c4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:43.019746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4d5f4d3c-267b-48a0-9dac-a9bc7c43d7c4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:43.020555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4d5f4d3c-267b-48a0-9dac-a9bc7c43d7c4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:43.021690 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4d5f4d3c-267b-48a0-9dac-a9bc7c43d7c4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:43.176367 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4d5f4d3c-267b-48a0-9dac-a9bc7c43d7c4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:43.188419 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4d5f4d3c-267b-48a0-9dac-a9bc7c43d7c4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:43.189991 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4d5f4d3c-267b-48a0-9dac-a9bc7c43d7c4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:43.191181 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4d5f4d3c-267b-48a0-9dac-a9bc7c43d7c4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1408 microversion: 2.20 time: 0.184658 Jul 04 09:23:43.191739 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 313/611] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:43 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:44.210106 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e809f119-7fc5-41d7-83ad-de4cbe8fd204 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:44.210927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e809f119-7fc5-41d7-83ad-de4cbe8fd204 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:44.221671 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e809f119-7fc5-41d7-83ad-de4cbe8fd204 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:44.222127 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e809f119-7fc5-41d7-83ad-de4cbe8fd204 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:44.223009 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e809f119-7fc5-41d7-83ad-de4cbe8fd204 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:44.223459 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e809f119-7fc5-41d7-83ad-de4cbe8fd204 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:44.370411 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e809f119-7fc5-41d7-83ad-de4cbe8fd204 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:44.385333 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e809f119-7fc5-41d7-83ad-de4cbe8fd204 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:44.386966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e809f119-7fc5-41d7-83ad-de4cbe8fd204 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:44.388198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e809f119-7fc5-41d7-83ad-de4cbe8fd204 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1601 microversion: 2.20 time: 0.182240 Jul 04 09:23:44.388745 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 299/612] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:23:44 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:23:44.405987 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-88a0f5da-e9df-4339-9e23-490125fff3aa tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:44.406557 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-88a0f5da-e9df-4339-9e23-490125fff3aa tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:44.413272 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-88a0f5da-e9df-4339-9e23-490125fff3aa tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:44.413767 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-88a0f5da-e9df-4339-9e23-490125fff3aa tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:44.414569 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-88a0f5da-e9df-4339-9e23-490125fff3aa tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:44.415040 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-88a0f5da-e9df-4339-9e23-490125fff3aa tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:44.500148 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-88a0f5da-e9df-4339-9e23-490125fff3aa tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098618 Jul 04 09:23:44.501278 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 314/613] 10.222.0.71 () {60 vars in 1315 bytes} [Mon Jul 4 09:23:44 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:23:44.815661 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9dbe52a1-3860-43f7-8b9b-f747d6edfe54 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Action: 'create', calling method: .version_select at 0x7fad7aaa4af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-608818780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2pd98qO35pvIEzKMW+bTyHZUKHb540koe35NSfGhIdow4qbdoy/ZKdoY6puhm2mxw5FJBmI2ZWaRc9mlRO1Mnixs7ak2K2QCJrJ+F+O5/Bt2UNISjYFGbFR0w+UqwKBw=="}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:44.830625 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-9dbe52a1-3860-43f7-8b9b-f747d6edfe54 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Getting quotas for project c1411a14411442a1bded43af5f67decd. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:23:44.834451 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-9dbe52a1-3860-43f7-8b9b-f747d6edfe54 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Getting quotas for user b5ed81725b574b01aba6c604fbf9ed50 and project c1411a14411442a1bded43af5f67decd. Resources: {'key_pairs'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:23:44.855878 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9dbe52a1-3860-43f7-8b9b-f747d6edfe54 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044103 Jul 04 09:23:44.857427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 300/614] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 4 09:23:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:44.913124 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1088507407", "imageRef": "4e967e5d-bdc1-45b0-acf7-da5e0f3d9a4b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-608818780", "networks": [{"uuid": "f7ac15de-29f7-484e-abc4-0f09d2da6dac"}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:44.965853 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] validate_networks() for [('f7ac15de-29f7-484e-abc4-0f09d2da6dac', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:23:45.837212 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:23:45.837821 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:23:45.838234 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:23:45.838713 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:23:45.839151 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:23:45.849535 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:45.849989 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:45.850782 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:45.851216 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:45.868964 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Getting quotas for project c1411a14411442a1bded43af5f67decd. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:23:45.874018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Getting quotas for user b5ed81725b574b01aba6c604fbf9ed50 and project c1411a14411442a1bded43af5f67decd. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:23:45.886607 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:23:45.888895 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4e967e5d-bdc1-45b0-acf7-da5e0f3d9a4b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:23:45.913408 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-15f3c416-0900-43df-86ab-da67b77b2d6b req-9c09ea6f-3b43-49ae-a691-5110d9ead5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1af165-f9ff-409d-a80d-0998b4f545d9", "tag": "a2d58751-fbe0-49d6-b04c-2629ea26d8f4"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:45.928644 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-15f3c416-0900-43df-86ab-da67b77b2d6b req-9c09ea6f-3b43-49ae-a691-5110d9ead5e2 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:45.929500 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-15f3c416-0900-43df-86ab-da67b77b2d6b req-9c09ea6f-3b43-49ae-a691-5110d9ead5e2 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:45.940285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bbc120f1-7ee7-4a04-96a9-3ab09ac5789c tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031419 Jul 04 09:23:45.940988 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 315/615] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:23:45.944328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-15f3c416-0900-43df-86ab-da67b77b2d6b req-9c09ea6f-3b43-49ae-a691-5110d9ead5e2 service nova] Creating event network-changed:a2d58751-fbe0-49d6-b04c-2629ea26d8f4 for instance fc1af165-f9ff-409d-a80d-0998b4f545d9 on hv-cinder-84456 Jul 04 09:23:45.951146 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-15f3c416-0900-43df-86ab-da67b77b2d6b req-9c09ea6f-3b43-49ae-a691-5110d9ead5e2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041766 Jul 04 09:23:45.952356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f53ed9a9-7c1a-4f8d-9a6e-e4d96047e3af tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:45.952588 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 301/616] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:23:45.953120 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f53ed9a9-7c1a-4f8d-9a6e-e4d96047e3af tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:46.014826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f53ed9a9-7c1a-4f8d-9a6e-e4d96047e3af tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:46.024487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f53ed9a9-7c1a-4f8d-9a6e-e4d96047e3af tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1258 microversion: 2.1 time: 0.077336 Jul 04 09:23:46.041716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 316/617] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:45 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1258 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:47.043443 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6489a6cd-05e7-43ac-ad14-44c58a4d2343 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:47.044203 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6489a6cd-05e7-43ac-ad14-44c58a4d2343 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:47.051879 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6489a6cd-05e7-43ac-ad14-44c58a4d2343 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:47.052390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6489a6cd-05e7-43ac-ad14-44c58a4d2343 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:47.053196 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6489a6cd-05e7-43ac-ad14-44c58a4d2343 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:47.053788 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6489a6cd-05e7-43ac-ad14-44c58a4d2343 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:47.141335 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6489a6cd-05e7-43ac-ad14-44c58a4d2343 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:47.149682 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6489a6cd-05e7-43ac-ad14-44c58a4d2343 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1318 microversion: 2.1 time: 0.110575 Jul 04 09:23:47.150624 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 302/618] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:47 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1318 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:48.174376 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0fb116d7-acc5-4bc1-9478-d5cc352ed4e2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:48.178964 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0fb116d7-acc5-4bc1-9478-d5cc352ed4e2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:48.202034 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0fb116d7-acc5-4bc1-9478-d5cc352ed4e2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:48.202508 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0fb116d7-acc5-4bc1-9478-d5cc352ed4e2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:48.203515 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0fb116d7-acc5-4bc1-9478-d5cc352ed4e2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:48.204061 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0fb116d7-acc5-4bc1-9478-d5cc352ed4e2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:48.380863 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0fb116d7-acc5-4bc1-9478-d5cc352ed4e2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:48.392858 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0fb116d7-acc5-4bc1-9478-d5cc352ed4e2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.225831 Jul 04 09:23:48.394128 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 317/619] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:48 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:49.410254 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cca41f4a-0a8b-43ab-a379-883b241e4eae tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:49.410875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cca41f4a-0a8b-43ab-a379-883b241e4eae tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:49.417542 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cca41f4a-0a8b-43ab-a379-883b241e4eae tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:49.417999 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cca41f4a-0a8b-43ab-a379-883b241e4eae tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:49.418766 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cca41f4a-0a8b-43ab-a379-883b241e4eae tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:49.419348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cca41f4a-0a8b-43ab-a379-883b241e4eae tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:49.567607 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-cca41f4a-0a8b-43ab-a379-883b241e4eae tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:49.575818 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cca41f4a-0a8b-43ab-a379-883b241e4eae tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.168819 Jul 04 09:23:49.576589 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 303/620] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:49 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:50.447594 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-616200da-e6a7-4ba8-88d7-c700b6fb8f68 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:50.448590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-616200da-e6a7-4ba8-88d7-c700b6fb8f68 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:50.455702 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-616200da-e6a7-4ba8-88d7-c700b6fb8f68 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:50.456156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-616200da-e6a7-4ba8-88d7-c700b6fb8f68 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:50.456936 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-616200da-e6a7-4ba8-88d7-c700b6fb8f68 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:50.457409 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-616200da-e6a7-4ba8-88d7-c700b6fb8f68 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:50.487553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-616200da-e6a7-4ba8-88d7-c700b6fb8f68 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043936 Jul 04 09:23:50.488109 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 318/621] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:23:50 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:23:50.547216 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e9538cb4-8ab2-41a4-92f4-a313db4559ac tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:50.547794 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e9538cb4-8ab2-41a4-92f4-a313db4559ac tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:50.554783 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e9538cb4-8ab2-41a4-92f4-a313db4559ac tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:50.555243 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e9538cb4-8ab2-41a4-92f4-a313db4559ac tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:50.556031 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e9538cb4-8ab2-41a4-92f4-a313db4559ac tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:50.557184 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e9538cb4-8ab2-41a4-92f4-a313db4559ac tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:50.585220 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e9538cb4-8ab2-41a4-92f4-a313db4559ac tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:23:50.592903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-56008c79-82c6-4d47-8770-af6a241d8f09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:50.593602 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-56008c79-82c6-4d47-8770-af6a241d8f09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:50.599652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56008c79-82c6-4d47-8770-af6a241d8f09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:50.600092 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56008c79-82c6-4d47-8770-af6a241d8f09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:50.600847 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56008c79-82c6-4d47-8770-af6a241d8f09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:50.601303 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56008c79-82c6-4d47-8770-af6a241d8f09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:50.613986 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:50.694224 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e9538cb4-8ab2-41a4-92f4-a313db4559ac tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 204 len: 0 microversion: 2.1 time: 0.151121 Jul 04 09:23:50.696849 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 304/622] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:23:50 2022] DELETE /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:23:50.706610 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fdd446e5-31d0-469e-bf40-f835f06ff310 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:50.707354 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fdd446e5-31d0-469e-bf40-f835f06ff310 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:50.713528 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fdd446e5-31d0-469e-bf40-f835f06ff310 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:50.714061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fdd446e5-31d0-469e-bf40-f835f06ff310 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:50.714903 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fdd446e5-31d0-469e-bf40-f835f06ff310 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:50.715423 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fdd446e5-31d0-469e-bf40-f835f06ff310 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:50.785388 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-56008c79-82c6-4d47-8770-af6a241d8f09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:50.799004 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-56008c79-82c6-4d47-8770-af6a241d8f09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.211107 Jul 04 09:23:50.808008 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 319/623] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:50 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:50.883669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fdd446e5-31d0-469e-bf40-f835f06ff310 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:50.892710 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fdd446e5-31d0-469e-bf40-f835f06ff310 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1675 microversion: 2.1 time: 0.190350 Jul 04 09:23:50.893625 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 305/624] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:50 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:51.815784 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cfd3ab46-c223-4131-b790-a427d73cbc09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:51.816452 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cfd3ab46-c223-4131-b790-a427d73cbc09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:51.819062 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:51.825011 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cfd3ab46-c223-4131-b790-a427d73cbc09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:51.825561 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cfd3ab46-c223-4131-b790-a427d73cbc09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:51.826394 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cfd3ab46-c223-4131-b790-a427d73cbc09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:51.826834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cfd3ab46-c223-4131-b790-a427d73cbc09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:51.833295 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:51.910464 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b7498e2a-bcfd-4aae-9e59-6b868d31eb83 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:51.911167 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b7498e2a-bcfd-4aae-9e59-6b868d31eb83 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:51.917512 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:51.919731 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b7498e2a-bcfd-4aae-9e59-6b868d31eb83 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:51.920257 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b7498e2a-bcfd-4aae-9e59-6b868d31eb83 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:51.921605 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b7498e2a-bcfd-4aae-9e59-6b868d31eb83 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:51.921932 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b7498e2a-bcfd-4aae-9e59-6b868d31eb83 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:51.992317 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cfd3ab46-c223-4131-b790-a427d73cbc09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:52.001120 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cfd3ab46-c223-4131-b790-a427d73cbc09 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.189075 Jul 04 09:23:52.001731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 320/625] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:51 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:52.111629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b7498e2a-bcfd-4aae-9e59-6b868d31eb83 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:52.119119 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b7498e2a-bcfd-4aae-9e59-6b868d31eb83 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1675 microversion: 2.1 time: 0.212529 Jul 04 09:23:52.119682 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 306/626] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:51 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:52.749749 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a0f2a689-6c8e-4e22-8ebb-c6b44778e428 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e2dd987-a6f5-4ec8-bb77-e9256de2af70"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:52.750868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a0f2a689-6c8e-4e22-8ebb-c6b44778e428 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:52.757146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0f2a689-6c8e-4e22-8ebb-c6b44778e428 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:52.757605 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0f2a689-6c8e-4e22-8ebb-c6b44778e428 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:52.758494 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0f2a689-6c8e-4e22-8ebb-c6b44778e428 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:52.758941 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0f2a689-6c8e-4e22-8ebb-c6b44778e428 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:53.018479 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ef7e615b-a78e-44f1-bae0-fb8f9f01fb6a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:53.019037 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ef7e615b-a78e-44f1-bae0-fb8f9f01fb6a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:53.026358 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef7e615b-a78e-44f1-bae0-fb8f9f01fb6a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:53.026813 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef7e615b-a78e-44f1-bae0-fb8f9f01fb6a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:53.027616 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef7e615b-a78e-44f1-bae0-fb8f9f01fb6a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:53.028055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ef7e615b-a78e-44f1-bae0-fb8f9f01fb6a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:53.165028 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ef7e615b-a78e-44f1-bae0-fb8f9f01fb6a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:53.172816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ef7e615b-a78e-44f1-bae0-fb8f9f01fb6a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.158108 Jul 04 09:23:53.173320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 307/627] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:53 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:53.177887 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3d4637a0-1440-4cbf-81a7-de8ad2fdce2b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:53.178577 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3d4637a0-1440-4cbf-81a7-de8ad2fdce2b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:53.187591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3d4637a0-1440-4cbf-81a7-de8ad2fdce2b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:53.188045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3d4637a0-1440-4cbf-81a7-de8ad2fdce2b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:53.188827 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3d4637a0-1440-4cbf-81a7-de8ad2fdce2b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:53.189313 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3d4637a0-1440-4cbf-81a7-de8ad2fdce2b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:53.339133 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3d4637a0-1440-4cbf-81a7-de8ad2fdce2b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:53.347490 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3d4637a0-1440-4cbf-81a7-de8ad2fdce2b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1675 microversion: 2.1 time: 0.173314 Jul 04 09:23:53.348050 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 308/628] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:53 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:53.573822 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-81e962fe-57fb-4d24-936f-64a68fce1695 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:53.574600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-81e962fe-57fb-4d24-936f-64a68fce1695 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:53.587470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-81e962fe-57fb-4d24-936f-64a68fce1695 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:53.588241 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-81e962fe-57fb-4d24-936f-64a68fce1695 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:53.589682 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-81e962fe-57fb-4d24-936f-64a68fce1695 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:53.590445 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-81e962fe-57fb-4d24-936f-64a68fce1695 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:53.630702 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-81e962fe-57fb-4d24-936f-64a68fce1695 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/ips" status: 200 len: 149 microversion: 2.1 time: 0.064135 Jul 04 09:23:53.631286 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 309/629] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 4 09:23:53 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/ips => generated 149 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:54.191610 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-415aa7fd-a62a-4a1a-8c06-90b56882d530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:54.193103 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-415aa7fd-a62a-4a1a-8c06-90b56882d530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:54.200768 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-415aa7fd-a62a-4a1a-8c06-90b56882d530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:54.201786 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-415aa7fd-a62a-4a1a-8c06-90b56882d530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:54.202305 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-415aa7fd-a62a-4a1a-8c06-90b56882d530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:54.202828 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-415aa7fd-a62a-4a1a-8c06-90b56882d530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:54.336920 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-415aa7fd-a62a-4a1a-8c06-90b56882d530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:54.345293 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-415aa7fd-a62a-4a1a-8c06-90b56882d530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.157647 Jul 04 09:23:54.345862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 310/630] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:54 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:54.365470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b1e5230f-6238-4007-8448-de1683fda766 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:54.366126 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b1e5230f-6238-4007-8448-de1683fda766 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:54.378236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1e5230f-6238-4007-8448-de1683fda766 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:54.378742 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1e5230f-6238-4007-8448-de1683fda766 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:54.379533 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1e5230f-6238-4007-8448-de1683fda766 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:54.380038 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b1e5230f-6238-4007-8448-de1683fda766 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:54.527454 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b1e5230f-6238-4007-8448-de1683fda766 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:54.536219 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b1e5230f-6238-4007-8448-de1683fda766 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1675 microversion: 2.1 time: 0.175034 Jul 04 09:23:54.537194 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 311/631] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:54 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:23:55.013590 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-492a347d-7293-4676-a3dc-b0bf2a816388 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9df8ce7b-36fc-43e7-b110-c95175ab0165"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:55.014848 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-492a347d-7293-4676-a3dc-b0bf2a816388 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:55.016860 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=4 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:55.024697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-492a347d-7293-4676-a3dc-b0bf2a816388 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:55.025207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-492a347d-7293-4676-a3dc-b0bf2a816388 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:55.026547 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-492a347d-7293-4676-a3dc-b0bf2a816388 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:55.027361 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-492a347d-7293-4676-a3dc-b0bf2a816388 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:55.860028 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:56.019381 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=8 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:23:58.855214 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a0f2a689-6c8e-4e22-8ebb-c6b44778e428 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.110521 Jul 04 09:23:58.857228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 321/632] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:23:52 2022] POST /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments => generated 194 bytes in 6113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:23:58.864156 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-492a347d-7293-4676-a3dc-b0bf2a816388 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.855264 Jul 04 09:23:58.864908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 312/633] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:23:55 2022] POST /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments => generated 194 bytes in 3857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:23:58.870983 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f6fb6e58-a31a-4b35-989c-2c1bbc3d543d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:58.871332 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5832683f-25af-47cc-af71-6be20b3ec819 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:23:58.871678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f6fb6e58-a31a-4b35-989c-2c1bbc3d543d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:58.871975 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5832683f-25af-47cc-af71-6be20b3ec819 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:23:58.878927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f6fb6e58-a31a-4b35-989c-2c1bbc3d543d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:58.879207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f6fb6e58-a31a-4b35-989c-2c1bbc3d543d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:58.879977 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f6fb6e58-a31a-4b35-989c-2c1bbc3d543d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:58.880470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f6fb6e58-a31a-4b35-989c-2c1bbc3d543d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:58.883634 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5832683f-25af-47cc-af71-6be20b3ec819 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:58.884285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5832683f-25af-47cc-af71-6be20b3ec819 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:58.885443 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5832683f-25af-47cc-af71-6be20b3ec819 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:58.886188 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5832683f-25af-47cc-af71-6be20b3ec819 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:59.094662 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f6fb6e58-a31a-4b35-989c-2c1bbc3d543d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:59.101994 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5832683f-25af-47cc-af71-6be20b3ec819 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:23:59.102317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f6fb6e58-a31a-4b35-989c-2c1bbc3d543d tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1675 microversion: 2.1 time: 0.236125 Jul 04 09:23:59.102893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 313/634] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:58 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1675 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:59.110193 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5832683f-25af-47cc-af71-6be20b3ec819 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.251051 Jul 04 09:23:59.110869 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 322/635] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:23:58 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:23:59.111783 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-7eb8ef9a-7f97-43f6-98c1-93440b39e68a req-a51064e5-66e9-4144-b738-52daf43544c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c288bc0-6da5-4db1-81a5-6a2122dcd793", "tag": "ba329408-a9df-4565-8cdc-da224a105d5c"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:23:59.120618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-7eb8ef9a-7f97-43f6-98c1-93440b39e68a req-a51064e5-66e9-4144-b738-52daf43544c9 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:23:59.121193 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-7eb8ef9a-7f97-43f6-98c1-93440b39e68a req-a51064e5-66e9-4144-b738-52daf43544c9 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:23:59.132260 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-7eb8ef9a-7f97-43f6-98c1-93440b39e68a req-a51064e5-66e9-4144-b738-52daf43544c9 service nova] Creating event network-changed:ba329408-a9df-4565-8cdc-da224a105d5c for instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 on hv-cinder-84456 Jul 04 09:23:59.137577 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-7eb8ef9a-7f97-43f6-98c1-93440b39e68a req-a51064e5-66e9-4144-b738-52daf43544c9 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029425 Jul 04 09:23:59.139017 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 314/636] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:00.128051 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cd5c1c1f-4d33-4954-92f9-39493028f819 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:00.128665 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cd5c1c1f-4d33-4954-92f9-39493028f819 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:00.128821 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-aae9480d-4b17-4139-b66f-40fe849c07cc tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:00.129414 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-aae9480d-4b17-4139-b66f-40fe849c07cc tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:00.135735 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aae9480d-4b17-4139-b66f-40fe849c07cc tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:00.135963 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd5c1c1f-4d33-4954-92f9-39493028f819 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:00.136189 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aae9480d-4b17-4139-b66f-40fe849c07cc tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:00.136421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd5c1c1f-4d33-4954-92f9-39493028f819 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:00.136968 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aae9480d-4b17-4139-b66f-40fe849c07cc tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:00.137391 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd5c1c1f-4d33-4954-92f9-39493028f819 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:00.137627 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aae9480d-4b17-4139-b66f-40fe849c07cc tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:00.138443 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cd5c1c1f-4d33-4954-92f9-39493028f819 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:00.212444 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cd5c1c1f-4d33-4954-92f9-39493028f819 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:00.222279 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cd5c1c1f-4d33-4954-92f9-39493028f819 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 200 len: 1607 microversion: 2.1 time: 0.097281 Jul 04 09:24:00.223512 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 323/637] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:00 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 1607 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:00.316211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-aae9480d-4b17-4139-b66f-40fe849c07cc tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:00.323924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-aae9480d-4b17-4139-b66f-40fe849c07cc tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.200170 Jul 04 09:24:00.324498 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 315/638] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:00 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:01.165481 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-5215ccaf-2282-4733-98c9-0c33d9374345 req-7261fad5-9dd1-4fef-8173-78729354e165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f72ca5c-5b7b-4f0f-9e77-e3279a898c25", "name": "network-vif-deleted", "tag": "7fc49830-0d78-454c-a8f0-695acad83764"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:01.175754 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-5215ccaf-2282-4733-98c9-0c33d9374345 req-7261fad5-9dd1-4fef-8173-78729354e165 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:01.176234 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-5215ccaf-2282-4733-98c9-0c33d9374345 req-7261fad5-9dd1-4fef-8173-78729354e165 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:01.191983 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-5215ccaf-2282-4733-98c9-0c33d9374345 req-7261fad5-9dd1-4fef-8173-78729354e165 service nova] Creating event network-vif-deleted:7fc49830-0d78-454c-a8f0-695acad83764 for instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 on hv-cinder-84456 Jul 04 09:24:01.197436 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-5215ccaf-2282-4733-98c9-0c33d9374345 req-7261fad5-9dd1-4fef-8173-78729354e165 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038055 Jul 04 09:24:01.198576 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 324/639] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:24:01.242529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c4a44829-d35e-49e2-985a-79fbae78c2c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:01.243740 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c4a44829-d35e-49e2-985a-79fbae78c2c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:01.251375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c4a44829-d35e-49e2-985a-79fbae78c2c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:01.251990 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c4a44829-d35e-49e2-985a-79fbae78c2c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:01.252985 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c4a44829-d35e-49e2-985a-79fbae78c2c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:01.253462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c4a44829-d35e-49e2-985a-79fbae78c2c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:01.268223 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-c4a44829-d35e-49e2-985a-79fbae78c2c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] HTTP exception thrown: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c4a44829-d35e-49e2-985a-79fbae78c2c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Request method failure captured: Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 HTTP/1.1 Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCYRK9LjDZcoDoRz5XL1cHZ_8sL5iREX6TakhIrZRmzJm3UYWltImN-VOTnlzeLRBQsTsbm3R_zXiioRnL1jkJip3sk69Xjcd4cDhDaSnnUCrqiQQW0v0uxSCSj6cz7foaUmrqJzQyjscNmsKW8Zr9NDCSk7kU6J0bq8UV7MU5ogPw Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:24:01.270045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_123c769553a1424e9c6dba4569bfaea5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: e50f9b53a10a43fa9b5fec03d01f451f Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:24:01.271669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '0f72ca5c-5b7b-4f0f-9e77-e3279a898c25'} Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:24:01.272862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:24:01.274431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:01.276174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c4a44829-d35e-49e2-985a-79fbae78c2c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Returning 404 to user: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:24:01.276174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c4a44829-d35e-49e2-985a-79fbae78c2c0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 404 len: 111 microversion: 2.1 time: 0.034899 Jul 04 09:24:01.276174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 316/640] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:01 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:24:01.281423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3a06dfc4-3e1b-4874-b142-4c6c777e7a9c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '.version_select at 0x7fad7ab19ee0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:01.301139 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3a06dfc4-3e1b-4874-b142-4c6c777e7a9c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-987467661" status: 202 len: 0 microversion: 2.1 time: 0.024271 Jul 04 09:24:01.301683 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 325/641] 10.222.0.71 () {58 vars in 1217 bytes} [Mon Jul 4 09:24:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-987467661 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:24:01.339717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e2845818-9e97-4870-a905-bdddf16f6906 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:01.340805 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e2845818-9e97-4870-a905-bdddf16f6906 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:01.349556 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2845818-9e97-4870-a905-bdddf16f6906 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:01.350402 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2845818-9e97-4870-a905-bdddf16f6906 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:01.351426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2845818-9e97-4870-a905-bdddf16f6906 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:01.352073 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e2845818-9e97-4870-a905-bdddf16f6906 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:01.569396 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e2845818-9e97-4870-a905-bdddf16f6906 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:01.578333 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e2845818-9e97-4870-a905-bdddf16f6906 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.242358 Jul 04 09:24:01.579198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 317/642] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:01 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:02.098076 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cdff05b5-30a6-4cc2-917d-6b1b9c50a356 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'create', calling method: .version_select at 0x7fad7aadb430>, body: {"keypair": {"name": "tempest-keypair-1674751112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmgt/cbj3zBQb0qgSUTrR9R6Jwa8s/x5yy9YEX9ThhTeIm8//hNTbcmH7UNvEUlMlvOvwRNKr3C2Xsx8j9+IbavrFpecV51+csAcjm+VNCXGdPt+Hr7WqKs/Aqq9dKoTg=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:02.112215 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-cdff05b5-30a6-4cc2-917d-6b1b9c50a356 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Getting quotas for project 123c769553a1424e9c6dba4569bfaea5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:24:02.116349 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-cdff05b5-30a6-4cc2-917d-6b1b9c50a356 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Getting quotas for user e50f9b53a10a43fa9b5fec03d01f451f and project 123c769553a1424e9c6dba4569bfaea5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:24:02.140545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cdff05b5-30a6-4cc2-917d-6b1b9c50a356 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046362 Jul 04 09:24:02.141180 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 326/643] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 4 09:24:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:02.607202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-88192b0e-6f69-4760-a3cb-337d16d2012d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:02.608293 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-88192b0e-6f69-4760-a3cb-337d16d2012d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:02.618321 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-88192b0e-6f69-4760-a3cb-337d16d2012d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:02.619007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-88192b0e-6f69-4760-a3cb-337d16d2012d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:02.619985 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-88192b0e-6f69-4760-a3cb-337d16d2012d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:02.620472 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-88192b0e-6f69-4760-a3cb-337d16d2012d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:03.070924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-88192b0e-6f69-4760-a3cb-337d16d2012d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:03.081591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-88192b0e-6f69-4760-a3cb-337d16d2012d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.480245 Jul 04 09:24:03.082723 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 318/644] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:02 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:03.670298 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-952272008", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20a12957-5ded-4250-8ffa-39871cf9bf25"}], "security_groups": [{"name": "tempest-securitygroup--788431812"}], "key_name": "tempest-keypair-1674751112", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:03.826276 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] validate_networks() for [('20a12957-5ded-4250-8ffa-39871cf9bf25', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:24:04.099076 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a0c3b39c-6381-4078-a031-eaa100dff063 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:04.099722 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a0c3b39c-6381-4078-a031-eaa100dff063 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:04.106262 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0c3b39c-6381-4078-a031-eaa100dff063 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:04.107249 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0c3b39c-6381-4078-a031-eaa100dff063 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:04.108216 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0c3b39c-6381-4078-a031-eaa100dff063 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:04.108661 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0c3b39c-6381-4078-a031-eaa100dff063 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:04.249862 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:24:04.250483 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:24:04.250968 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:24:04.251495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:24:04.251919 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:24:04.260806 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:04.261309 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:04.262121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:04.262567 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:04.280751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Getting quotas for project 123c769553a1424e9c6dba4569bfaea5. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:24:04.285621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Getting quotas for user e50f9b53a10a43fa9b5fec03d01f451f and project 123c769553a1424e9c6dba4569bfaea5. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:24:04.300363 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:24:04.302972 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:24:04.313718 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a0c3b39c-6381-4078-a031-eaa100dff063 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:04.322878 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a0c3b39c-6381-4078-a031-eaa100dff063 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.227479 Jul 04 09:24:04.323495 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 319/645] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:04 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:04.369715 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bcf17829-db08-4d34-9e78-7b1c31ecbe35 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.704329 Jul 04 09:24:04.370522 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 327/646] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:24:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:24:04.380943 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-98247016-7611-4e3a-b0a7-4b7446aee9d0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:04.381662 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-98247016-7611-4e3a-b0a7-4b7446aee9d0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:04.435884 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-98247016-7611-4e3a-b0a7-4b7446aee9d0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:04.442681 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-98247016-7611-4e3a-b0a7-4b7446aee9d0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1237 microversion: 2.1 time: 0.065547 Jul 04 09:24:04.443252 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 320/647] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:04 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:05.024150 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-e5580e34-bb4e-40b8-af1c-477e34707278 req-d6c7a9f9-de9e-4746-b424-80cc0f4fe164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c288bc0-6da5-4db1-81a5-6a2122dcd793", "name": "network-vif-plugged", "status": "completed", "tag": "ba329408-a9df-4565-8cdc-da224a105d5c"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:05.034018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e5580e34-bb4e-40b8-af1c-477e34707278 req-d6c7a9f9-de9e-4746-b424-80cc0f4fe164 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:05.034458 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e5580e34-bb4e-40b8-af1c-477e34707278 req-d6c7a9f9-de9e-4746-b424-80cc0f4fe164 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:05.059211 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-e5580e34-bb4e-40b8-af1c-477e34707278 req-d6c7a9f9-de9e-4746-b424-80cc0f4fe164 service nova] Creating event network-vif-plugged:ba329408-a9df-4565-8cdc-da224a105d5c for instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 on hv-cinder-84456 Jul 04 09:24:05.068334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-e5580e34-bb4e-40b8-af1c-477e34707278 req-d6c7a9f9-de9e-4746-b424-80cc0f4fe164 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047952 Jul 04 09:24:05.069439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 328/648] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:05.346238 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9f4650ad-01b3-4fcc-b252-0dd30dca8980 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:05.346857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9f4650ad-01b3-4fcc-b252-0dd30dca8980 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:05.353558 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f4650ad-01b3-4fcc-b252-0dd30dca8980 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:05.354011 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f4650ad-01b3-4fcc-b252-0dd30dca8980 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:05.354774 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f4650ad-01b3-4fcc-b252-0dd30dca8980 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:05.355211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9f4650ad-01b3-4fcc-b252-0dd30dca8980 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:05.459858 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3df089cf-cf5a-4f83-b822-0dc55c728471 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:05.460849 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3df089cf-cf5a-4f83-b822-0dc55c728471 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:05.469277 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3df089cf-cf5a-4f83-b822-0dc55c728471 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:05.470023 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3df089cf-cf5a-4f83-b822-0dc55c728471 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:05.470797 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3df089cf-cf5a-4f83-b822-0dc55c728471 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:05.471238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3df089cf-cf5a-4f83-b822-0dc55c728471 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:05.512211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9f4650ad-01b3-4fcc-b252-0dd30dca8980 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:05.517243 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:05.526048 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9f4650ad-01b3-4fcc-b252-0dd30dca8980 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.183593 Jul 04 09:24:05.529060 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 321/649] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:05 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:05.556356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3df089cf-cf5a-4f83-b822-0dc55c728471 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:05.565160 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3df089cf-cf5a-4f83-b822-0dc55c728471 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1233 microversion: 2.1 time: 0.109251 Jul 04 09:24:05.565746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 329/650] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:05 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1233 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:06.415488 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-622781ea-2814-4161-bf4b-c86e63a8c852 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:06.416481 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-622781ea-2814-4161-bf4b-c86e63a8c852 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:06.424664 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-622781ea-2814-4161-bf4b-c86e63a8c852 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:06.425244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-622781ea-2814-4161-bf4b-c86e63a8c852 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:06.426019 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-622781ea-2814-4161-bf4b-c86e63a8c852 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:06.426454 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-622781ea-2814-4161-bf4b-c86e63a8c852 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:06.454689 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-622781ea-2814-4161-bf4b-c86e63a8c852 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lazy-loading 'flavor' on Instance uuid 80be812b-a9c3-4327-b55b-0dbcf97a12c7 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:24:06.545685 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6af7cd6a-87ca-4577-9c07-74682d6a6b98 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:06.546414 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6af7cd6a-87ca-4577-9c07-74682d6a6b98 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:06.553051 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6af7cd6a-87ca-4577-9c07-74682d6a6b98 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:06.553608 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6af7cd6a-87ca-4577-9c07-74682d6a6b98 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:06.554465 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6af7cd6a-87ca-4577-9c07-74682d6a6b98 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:06.555063 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6af7cd6a-87ca-4577-9c07-74682d6a6b98 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:06.658492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-622781ea-2814-4161-bf4b-c86e63a8c852 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/action" status: 200 len: 32 microversion: 2.1 time: 0.246696 Jul 04 09:24:06.663304 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 322/651] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:24:06 2022] POST /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/action => generated 32 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:24:06.668658 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c5004b20-3576-4f6e-aa34-d8c370e34d13 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:06.670770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c5004b20-3576-4f6e-aa34-d8c370e34d13 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:06.678873 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c5004b20-3576-4f6e-aa34-d8c370e34d13 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:06.689820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c5004b20-3576-4f6e-aa34-d8c370e34d13 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:06.690847 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c5004b20-3576-4f6e-aa34-d8c370e34d13 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:06.691546 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c5004b20-3576-4f6e-aa34-d8c370e34d13 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:06.706079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6af7cd6a-87ca-4577-9c07-74682d6a6b98 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:06.717388 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6af7cd6a-87ca-4577-9c07-74682d6a6b98 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1358 microversion: 2.1 time: 0.176058 Jul 04 09:24:06.718530 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 330/652] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:06 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:06.723509 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5abd01d2-aa7b-4e01-bab2-30b3bbe5c1d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:06.724125 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5abd01d2-aa7b-4e01-bab2-30b3bbe5c1d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:06.730293 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5abd01d2-aa7b-4e01-bab2-30b3bbe5c1d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:06.730746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5abd01d2-aa7b-4e01-bab2-30b3bbe5c1d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:06.732355 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5abd01d2-aa7b-4e01-bab2-30b3bbe5c1d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:06.732981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5abd01d2-aa7b-4e01-bab2-30b3bbe5c1d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:06.778033 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c5004b20-3576-4f6e-aa34-d8c370e34d13 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:06.791853 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c5004b20-3576-4f6e-aa34-d8c370e34d13 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1295 microversion: 2.1 time: 0.127115 Jul 04 09:24:06.792531 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 323/653] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:06 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:06.876276 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5abd01d2-aa7b-4e01-bab2-30b3bbe5c1d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:06.890212 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5abd01d2-aa7b-4e01-bab2-30b3bbe5c1d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.170439 Jul 04 09:24:06.890950 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 331/654] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:06 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:07.733743 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-aef10c77-0dbe-4c2b-9148-1a29583bebc2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:07.734950 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-aef10c77-0dbe-4c2b-9148-1a29583bebc2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:07.741745 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aef10c77-0dbe-4c2b-9148-1a29583bebc2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:07.742203 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aef10c77-0dbe-4c2b-9148-1a29583bebc2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:07.742983 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aef10c77-0dbe-4c2b-9148-1a29583bebc2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:07.743425 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aef10c77-0dbe-4c2b-9148-1a29583bebc2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:07.811746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-263dbba0-0090-4000-bf15-95717e6ec5c1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:07.812364 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-263dbba0-0090-4000-bf15-95717e6ec5c1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:07.819306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-263dbba0-0090-4000-bf15-95717e6ec5c1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:07.819975 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-263dbba0-0090-4000-bf15-95717e6ec5c1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:07.820758 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-263dbba0-0090-4000-bf15-95717e6ec5c1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:07.821236 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-263dbba0-0090-4000-bf15-95717e6ec5c1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:07.915492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-aef10c77-0dbe-4c2b-9148-1a29583bebc2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:07.925692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-aef10c77-0dbe-4c2b-9148-1a29583bebc2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1548 microversion: 2.1 time: 0.196108 Jul 04 09:24:07.926277 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 324/655] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:07 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1548 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:07.931357 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e644bc9e-f0fa-46bc-a5c3-da18fa4d7eac tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:07.932060 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e644bc9e-f0fa-46bc-a5c3-da18fa4d7eac tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:07.938935 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e644bc9e-f0fa-46bc-a5c3-da18fa4d7eac tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:07.939392 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e644bc9e-f0fa-46bc-a5c3-da18fa4d7eac tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:07.940290 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e644bc9e-f0fa-46bc-a5c3-da18fa4d7eac tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:07.940735 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e644bc9e-f0fa-46bc-a5c3-da18fa4d7eac tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:07.994836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-263dbba0-0090-4000-bf15-95717e6ec5c1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:08.004313 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-263dbba0-0090-4000-bf15-95717e6ec5c1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1362 microversion: 2.1 time: 0.197732 Jul 04 09:24:08.005533 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 332/656] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:07 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:08.012278 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ba84f40b-07ef-423f-9a75-66ea67d60530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:08.014572 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ba84f40b-07ef-423f-9a75-66ea67d60530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:08.020776 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba84f40b-07ef-423f-9a75-66ea67d60530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:08.021391 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba84f40b-07ef-423f-9a75-66ea67d60530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:08.022237 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba84f40b-07ef-423f-9a75-66ea67d60530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:08.022880 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba84f40b-07ef-423f-9a75-66ea67d60530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:08.118900 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e644bc9e-f0fa-46bc-a5c3-da18fa4d7eac tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:08.127801 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e644bc9e-f0fa-46bc-a5c3-da18fa4d7eac tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.200302 Jul 04 09:24:08.128376 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 325/657] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:07 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:08.178839 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ba84f40b-07ef-423f-9a75-66ea67d60530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:08.187704 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ba84f40b-07ef-423f-9a75-66ea67d60530 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1548 microversion: 2.1 time: 0.180823 Jul 04 09:24:08.188401 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 333/658] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:08 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1548 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:08.203621 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1dcf4671-666d-4186-980a-0e6a397e814a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:08.207316 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1dcf4671-666d-4186-980a-0e6a397e814a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:08.208115 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1dcf4671-666d-4186-980a-0e6a397e814a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Searching by: {'deleted': False, 'project_id': 'c1411a14411442a1bded43af5f67decd'} {{(pid=117665) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 04 09:24:08.214755 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1dcf4671-666d-4186-980a-0e6a397e814a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:08.215199 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1dcf4671-666d-4186-980a-0e6a397e814a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:08.216819 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1dcf4671-666d-4186-980a-0e6a397e814a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:08.217421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1dcf4671-666d-4186-980a-0e6a397e814a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:08.309984 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.multi_cell_list [None req-1dcf4671-666d-4186-980a-0e6a397e814a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117665) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 04 09:24:08.410203 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1dcf4671-666d-4186-980a-0e6a397e814a tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210652 Jul 04 09:24:08.410867 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 326/659] 10.222.0.71 () {58 vars in 1124 bytes} [Mon Jul 4 09:24:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:08.424296 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8b194b51-3da8-4f03-a936-551f57995969 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:08.426276 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8b194b51-3da8-4f03-a936-551f57995969 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:08.435156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b194b51-3da8-4f03-a936-551f57995969 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:08.435625 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b194b51-3da8-4f03-a936-551f57995969 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:08.436597 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b194b51-3da8-4f03-a936-551f57995969 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:08.437405 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b194b51-3da8-4f03-a936-551f57995969 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:08.612581 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-39ea9eae-f01c-4cb3-b134-5fd7bb623640 req-7070223f-2f9d-4922-a3f4-20dc9d414bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf3ecbe-ac29-4c45-a385-f8fa5c699e5d", "tag": "fd94d403-49cf-477b-9ae8-84dc8eff0d60"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:08.622741 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-39ea9eae-f01c-4cb3-b134-5fd7bb623640 req-7070223f-2f9d-4922-a3f4-20dc9d414bd7 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:08.623378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-39ea9eae-f01c-4cb3-b134-5fd7bb623640 req-7070223f-2f9d-4922-a3f4-20dc9d414bd7 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:08.636899 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8b194b51-3da8-4f03-a936-551f57995969 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:08.643156 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-39ea9eae-f01c-4cb3-b134-5fd7bb623640 req-7070223f-2f9d-4922-a3f4-20dc9d414bd7 service nova] Creating event network-changed:fd94d403-49cf-477b-9ae8-84dc8eff0d60 for instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d on hv-cinder-84456 Jul 04 09:24:08.648068 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-39ea9eae-f01c-4cb3-b134-5fd7bb623640 req-7070223f-2f9d-4922-a3f4-20dc9d414bd7 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046875 Jul 04 09:24:08.648504 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 327/660] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:08.653954 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8b194b51-3da8-4f03-a936-551f57995969 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1548 microversion: 2.1 time: 0.236359 Jul 04 09:24:08.654749 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 334/661] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:08 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:09.022609 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-96be9c49-8488-49dd-a58b-1bbd62a38f56 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:09.023349 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-96be9c49-8488-49dd-a58b-1bbd62a38f56 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:09.031029 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-96be9c49-8488-49dd-a58b-1bbd62a38f56 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:09.031514 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-96be9c49-8488-49dd-a58b-1bbd62a38f56 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:09.032302 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-96be9c49-8488-49dd-a58b-1bbd62a38f56 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:09.032747 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-96be9c49-8488-49dd-a58b-1bbd62a38f56 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:09.146837 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-22c6e29d-5a57-46c1-9f67-f9a7f2aa0a0e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:09.147458 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-22c6e29d-5a57-46c1-9f67-f9a7f2aa0a0e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:09.154925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-22c6e29d-5a57-46c1-9f67-f9a7f2aa0a0e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:09.155730 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-22c6e29d-5a57-46c1-9f67-f9a7f2aa0a0e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:09.157410 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-22c6e29d-5a57-46c1-9f67-f9a7f2aa0a0e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:09.157855 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-22c6e29d-5a57-46c1-9f67-f9a7f2aa0a0e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:09.178200 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-96be9c49-8488-49dd-a58b-1bbd62a38f56 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:09.186592 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-96be9c49-8488-49dd-a58b-1bbd62a38f56 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1362 microversion: 2.1 time: 0.168715 Jul 04 09:24:09.187412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 328/662] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:09 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:09.299151 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-22c6e29d-5a57-46c1-9f67-f9a7f2aa0a0e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:09.307171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-22c6e29d-5a57-46c1-9f67-f9a7f2aa0a0e tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.165752 Jul 04 09:24:09.307750 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 335/663] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:09 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:10.185191 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7083f5eb-0018-4ab7-9f27-2c4e12d1520b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7907b121-26b1-4d27-b760-02886b95249e"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:10.186338 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7083f5eb-0018-4ab7-9f27-2c4e12d1520b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:10.192838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7083f5eb-0018-4ab7-9f27-2c4e12d1520b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:10.193329 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7083f5eb-0018-4ab7-9f27-2c4e12d1520b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:10.194100 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7083f5eb-0018-4ab7-9f27-2c4e12d1520b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:10.194538 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7083f5eb-0018-4ab7-9f27-2c4e12d1520b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:10.203770 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3a10b2ef-fc75-4353-a8cd-79aef39ead4c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:10.204384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3a10b2ef-fc75-4353-a8cd-79aef39ead4c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:10.210829 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a10b2ef-fc75-4353-a8cd-79aef39ead4c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:10.211284 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a10b2ef-fc75-4353-a8cd-79aef39ead4c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:10.212046 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a10b2ef-fc75-4353-a8cd-79aef39ead4c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:10.212502 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3a10b2ef-fc75-4353-a8cd-79aef39ead4c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:10.346016 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3a10b2ef-fc75-4353-a8cd-79aef39ead4c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:10.353903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3a10b2ef-fc75-4353-a8cd-79aef39ead4c tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1362 microversion: 2.1 time: 0.153913 Jul 04 09:24:10.354765 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 336/664] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:10 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:10.360103 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d965b964-56bf-4345-bb81-ce5cf626e5bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:10.360719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d965b964-56bf-4345-bb81-ce5cf626e5bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:10.366774 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d965b964-56bf-4345-bb81-ce5cf626e5bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:10.367232 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d965b964-56bf-4345-bb81-ce5cf626e5bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:10.368012 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d965b964-56bf-4345-bb81-ce5cf626e5bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:10.368843 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d965b964-56bf-4345-bb81-ce5cf626e5bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:10.530480 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7083f5eb-0018-4ab7-9f27-2c4e12d1520b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "POST /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349506 Jul 04 09:24:10.531366 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 329/665] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:24:10 2022] POST /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:10.550028 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d965b964-56bf-4345-bb81-ce5cf626e5bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:10.559793 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d965b964-56bf-4345-bb81-ce5cf626e5bd tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.203600 Jul 04 09:24:10.560652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 337/666] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:10 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:11.373511 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4530df81-83dc-4fd6-809b-8b02d88ace8a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:11.374207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4530df81-83dc-4fd6-809b-8b02d88ace8a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:11.382340 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4530df81-83dc-4fd6-809b-8b02d88ace8a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:11.382796 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4530df81-83dc-4fd6-809b-8b02d88ace8a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:11.383611 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4530df81-83dc-4fd6-809b-8b02d88ace8a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:11.384082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4530df81-83dc-4fd6-809b-8b02d88ace8a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:11.527956 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4530df81-83dc-4fd6-809b-8b02d88ace8a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:11.535971 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4530df81-83dc-4fd6-809b-8b02d88ace8a tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1362 microversion: 2.1 time: 0.167993 Jul 04 09:24:11.536534 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 330/667] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:11 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:11.577848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7da73644-d9fc-4cc4-925d-69df34853e59 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:11.578459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7da73644-d9fc-4cc4-925d-69df34853e59 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:11.585290 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7da73644-d9fc-4cc4-925d-69df34853e59 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:11.585737 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7da73644-d9fc-4cc4-925d-69df34853e59 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:11.586504 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7da73644-d9fc-4cc4-925d-69df34853e59 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:11.586976 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7da73644-d9fc-4cc4-925d-69df34853e59 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:11.726703 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7da73644-d9fc-4cc4-925d-69df34853e59 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:11.735848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7da73644-d9fc-4cc4-925d-69df34853e59 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.162645 Jul 04 09:24:11.736429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 338/668] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:11 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:12.553620 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-515b15d0-c645-4e63-8a58-845256853574 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:12.554227 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-515b15d0-c645-4e63-8a58-845256853574 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:12.561482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-515b15d0-c645-4e63-8a58-845256853574 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:12.561935 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-515b15d0-c645-4e63-8a58-845256853574 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:12.562693 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-515b15d0-c645-4e63-8a58-845256853574 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:12.563130 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-515b15d0-c645-4e63-8a58-845256853574 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:12.694449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-515b15d0-c645-4e63-8a58-845256853574 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:12.702624 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-515b15d0-c645-4e63-8a58-845256853574 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1362 microversion: 2.1 time: 0.152807 Jul 04 09:24:12.703355 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 331/669] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:12 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:12.754297 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-71a1465b-862d-4682-b40d-2460c952d728 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:12.754899 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-71a1465b-862d-4682-b40d-2460c952d728 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:12.761321 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71a1465b-862d-4682-b40d-2460c952d728 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:12.761766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71a1465b-862d-4682-b40d-2460c952d728 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:12.763177 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71a1465b-862d-4682-b40d-2460c952d728 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:12.763962 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-71a1465b-862d-4682-b40d-2460c952d728 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:12.780795 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:12.895110 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c95b9cf3-520d-427a-8d42-15456d9d5cc0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9df8ce7b-36fc-43e7-b110-c95175ab0165"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:12.896410 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c95b9cf3-520d-427a-8d42-15456d9d5cc0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:12.902424 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c95b9cf3-520d-427a-8d42-15456d9d5cc0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:12.902888 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c95b9cf3-520d-427a-8d42-15456d9d5cc0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:12.903376 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-71a1465b-862d-4682-b40d-2460c952d728 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:12.903722 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c95b9cf3-520d-427a-8d42-15456d9d5cc0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:12.904168 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c95b9cf3-520d-427a-8d42-15456d9d5cc0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:12.912454 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-71a1465b-862d-4682-b40d-2460c952d728 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.161983 Jul 04 09:24:12.916063 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 339/670] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:12 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:12.993550 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-c95b9cf3-520d-427a-8d42-15456d9d5cc0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Invalid volume: volume 9df8ce7b-36fc-43e7-b110-c95175ab0165 is already attached to instances: 63068e8d-61aa-4db4-aa29-b3b179933ba9 Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c95b9cf3-520d-427a-8d42-15456d9d5cc0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: POST /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments HTTP/1.1 Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 74 Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:24:12.995319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {"volumeAttachment": {"volumeId": "9df8ce7b-36fc-43e7-b110-c95175ab0165"}} Jul 04 09:24:12.997482 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Invalid volume: volume 9df8ce7b-36fc-43e7-b110-c95175ab0165 is already attached to instances: 63068e8d-61aa-4db4-aa29-b3b179933ba9 Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'server_id': '63068e8d-61aa-4db4-aa29-b3b179933ba9', 'body': {'volumeAttachment': {'volumeId': '9df8ce7b-36fc-43e7-b110-c95175ab0165'}}} Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9df8ce7b-36fc-43e7-b110-c95175ab0165 is already attached to instances: 63068e8d-61aa-4db4-aa29-b3b179933ba9 Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:12.998530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9df8ce7b-36fc-43e7-b110-c95175ab0165 is already attached to instances: 63068e8d-61aa-4db4-aa29-b3b179933ba9 Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:12.999706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:24:13.001002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:24:13.001002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:24:13.001002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:24:13.001002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9df8ce7b-36fc-43e7-b110-c95175ab0165 is already attached to instances: 63068e8d-61aa-4db4-aa29-b3b179933ba9 Jul 04 09:24:13.001002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:13.001002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c95b9cf3-520d-427a-8d42-15456d9d5cc0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 400 to user: Invalid volume: volume 9df8ce7b-36fc-43e7-b110-c95175ab0165 is already attached to instances: 63068e8d-61aa-4db4-aa29-b3b179933ba9 {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:24:13.001002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c95b9cf3-520d-427a-8d42-15456d9d5cc0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105884 Jul 04 09:24:13.001002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 332/671] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:24:12 2022] POST /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 04 09:24:13.064111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-faaf6643-592e-428f-bcca-a8689e9a8c3e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:13.064832 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-faaf6643-592e-428f-bcca-a8689e9a8c3e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:13.070846 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-faaf6643-592e-428f-bcca-a8689e9a8c3e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:13.071363 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-faaf6643-592e-428f-bcca-a8689e9a8c3e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:13.072151 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-faaf6643-592e-428f-bcca-a8689e9a8c3e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:13.072631 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-faaf6643-592e-428f-bcca-a8689e9a8c3e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:13.161949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-faaf6643-592e-428f-bcca-a8689e9a8c3e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lazy-loading 'services' on Instance uuid 63068e8d-61aa-4db4-aa29-b3b179933ba9 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:24:13.233487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-faaf6643-592e-428f-bcca-a8689e9a8c3e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments/9df8ce7b-36fc-43e7-b110-c95175ab0165" status: 202 len: 0 microversion: 2.1 time: 0.173632 Jul 04 09:24:13.234081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 340/672] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:24:13 2022] DELETE /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments/9df8ce7b-36fc-43e7-b110-c95175ab0165 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:24:13.242260 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-eedfe63a-3aa1-4094-8a0b-41de80443796 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:13.243243 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-eedfe63a-3aa1-4094-8a0b-41de80443796 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:13.250979 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eedfe63a-3aa1-4094-8a0b-41de80443796 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:13.251432 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eedfe63a-3aa1-4094-8a0b-41de80443796 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:13.252202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eedfe63a-3aa1-4094-8a0b-41de80443796 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:13.252814 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eedfe63a-3aa1-4094-8a0b-41de80443796 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:13.286615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-eedfe63a-3aa1-4094-8a0b-41de80443796 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047920 Jul 04 09:24:13.287533 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 333/673] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:24:13 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:13.720524 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-229ec815-4052-4c17-927c-de31d0dfdec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:13.721270 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-229ec815-4052-4c17-927c-de31d0dfdec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:13.727598 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-229ec815-4052-4c17-927c-de31d0dfdec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:13.728055 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-229ec815-4052-4c17-927c-de31d0dfdec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:13.728839 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-229ec815-4052-4c17-927c-de31d0dfdec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:13.729309 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-229ec815-4052-4c17-927c-de31d0dfdec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:13.865852 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-229ec815-4052-4c17-927c-de31d0dfdec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:13.874595 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-229ec815-4052-4c17-927c-de31d0dfdec0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1362 microversion: 2.1 time: 0.158676 Jul 04 09:24:13.875161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 341/674] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:13 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:13.928663 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-047b40f3-7781-46af-9d6d-d95d981ec6a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:13.929252 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-047b40f3-7781-46af-9d6d-d95d981ec6a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:13.936138 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-047b40f3-7781-46af-9d6d-d95d981ec6a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:13.936591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-047b40f3-7781-46af-9d6d-d95d981ec6a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:13.937421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-047b40f3-7781-46af-9d6d-d95d981ec6a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:13.937864 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-047b40f3-7781-46af-9d6d-d95d981ec6a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:14.067206 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-047b40f3-7781-46af-9d6d-d95d981ec6a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:14.075421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-047b40f3-7781-46af-9d6d-d95d981ec6a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.150419 Jul 04 09:24:14.076076 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 334/675] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:13 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:14.301059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:14.301792 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=10 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:14.419993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c85dc5c5-89c6-4376-81bc-02335f838048 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:14.421173 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c85dc5c5-89c6-4376-81bc-02335f838048 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:14.427377 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c85dc5c5-89c6-4376-81bc-02335f838048 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:14.427916 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c85dc5c5-89c6-4376-81bc-02335f838048 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:14.428760 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c85dc5c5-89c6-4376-81bc-02335f838048 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:14.429302 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c85dc5c5-89c6-4376-81bc-02335f838048 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:14.459649 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c85dc5c5-89c6-4376-81bc-02335f838048 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162997 Jul 04 09:24:14.460045 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 342/676] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:24:14 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:14.891317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-231bdc18-0124-4acf-981f-0959abce2966 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:14.891948 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-231bdc18-0124-4acf-981f-0959abce2966 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:14.894370 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:14.899670 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-231bdc18-0124-4acf-981f-0959abce2966 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:14.900119 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-231bdc18-0124-4acf-981f-0959abce2966 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:14.900872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-231bdc18-0124-4acf-981f-0959abce2966 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:14.901336 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-231bdc18-0124-4acf-981f-0959abce2966 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:14.923007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:15.039520 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-231bdc18-0124-4acf-981f-0959abce2966 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:15.048469 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-231bdc18-0124-4acf-981f-0959abce2966 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1362 microversion: 2.1 time: 0.160914 Jul 04 09:24:15.049072 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 335/677] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:14 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:15.074161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-c023d110-6279-4e6d-9e5e-8ee6f6747f0e req-adaff3b0-25e8-4359-a3d4-f9a3caf6fb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf3ecbe-ac29-4c45-a385-f8fa5c699e5d", "name": "network-vif-plugged", "status": "completed", "tag": "fd94d403-49cf-477b-9ae8-84dc8eff0d60"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:15.083915 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c023d110-6279-4e6d-9e5e-8ee6f6747f0e req-adaff3b0-25e8-4359-a3d4-f9a3caf6fb7a service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:15.084372 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c023d110-6279-4e6d-9e5e-8ee6f6747f0e req-adaff3b0-25e8-4359-a3d4-f9a3caf6fb7a service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:15.092710 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-04e61ec3-81ad-46dc-bf1d-13de3ca42c4b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:15.093603 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-04e61ec3-81ad-46dc-bf1d-13de3ca42c4b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:15.097552 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-c023d110-6279-4e6d-9e5e-8ee6f6747f0e req-adaff3b0-25e8-4359-a3d4-f9a3caf6fb7a service nova] Creating event network-vif-plugged:fd94d403-49cf-477b-9ae8-84dc8eff0d60 for instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d on hv-cinder-84456 Jul 04 09:24:15.099728 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04e61ec3-81ad-46dc-bf1d-13de3ca42c4b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:15.100184 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04e61ec3-81ad-46dc-bf1d-13de3ca42c4b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:15.100967 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04e61ec3-81ad-46dc-bf1d-13de3ca42c4b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:15.101441 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04e61ec3-81ad-46dc-bf1d-13de3ca42c4b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:15.102606 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-c023d110-6279-4e6d-9e5e-8ee6f6747f0e req-adaff3b0-25e8-4359-a3d4-f9a3caf6fb7a service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032278 Jul 04 09:24:15.103523 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 343/678] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:15.247470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-04e61ec3-81ad-46dc-bf1d-13de3ca42c4b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:15.255629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-04e61ec3-81ad-46dc-bf1d-13de3ca42c4b tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.167076 Jul 04 09:24:15.256211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 336/679] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:15 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:15.473126 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e36103e4-661a-49d6-896b-0f35add9a68a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:15.474129 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e36103e4-661a-49d6-896b-0f35add9a68a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:15.480269 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e36103e4-661a-49d6-896b-0f35add9a68a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:15.480721 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e36103e4-661a-49d6-896b-0f35add9a68a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:15.482740 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e36103e4-661a-49d6-896b-0f35add9a68a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:15.483208 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e36103e4-661a-49d6-896b-0f35add9a68a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:15.513652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e36103e4-661a-49d6-896b-0f35add9a68a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 Jul 04 09:24:15.514202 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 344/680] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:24:15 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:16.065733 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-99435d2c-98b7-4e4a-b87a-18cac3759ac0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:16.066267 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-99435d2c-98b7-4e4a-b87a-18cac3759ac0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:16.072792 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-99435d2c-98b7-4e4a-b87a-18cac3759ac0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:16.073290 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-99435d2c-98b7-4e4a-b87a-18cac3759ac0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:16.074061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-99435d2c-98b7-4e4a-b87a-18cac3759ac0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:16.074498 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-99435d2c-98b7-4e4a-b87a-18cac3759ac0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:16.209302 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-99435d2c-98b7-4e4a-b87a-18cac3759ac0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:16.218203 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-99435d2c-98b7-4e4a-b87a-18cac3759ac0 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1362 microversion: 2.1 time: 0.156302 Jul 04 09:24:16.218797 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 337/681] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:16 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:16.273080 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-75bb459a-fcbb-402f-a6bd-c78ea8eef56a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:16.273688 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-75bb459a-fcbb-402f-a6bd-c78ea8eef56a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:16.281160 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-75bb459a-fcbb-402f-a6bd-c78ea8eef56a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:16.281624 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-75bb459a-fcbb-402f-a6bd-c78ea8eef56a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:16.282398 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-75bb459a-fcbb-402f-a6bd-c78ea8eef56a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:16.282834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-75bb459a-fcbb-402f-a6bd-c78ea8eef56a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:16.417310 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-75bb459a-fcbb-402f-a6bd-c78ea8eef56a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:16.427418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-75bb459a-fcbb-402f-a6bd-c78ea8eef56a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.158303 Jul 04 09:24:16.427995 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 345/682] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:16 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:16.525398 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-04acd850-8716-47ff-882e-f967ff6da452 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:16.526406 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-04acd850-8716-47ff-882e-f967ff6da452 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:16.532975 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04acd850-8716-47ff-882e-f967ff6da452 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:16.533454 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04acd850-8716-47ff-882e-f967ff6da452 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:16.534209 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04acd850-8716-47ff-882e-f967ff6da452 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:16.534645 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04acd850-8716-47ff-882e-f967ff6da452 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:16.564759 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-04acd850-8716-47ff-882e-f967ff6da452 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043312 Jul 04 09:24:16.565360 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 338/683] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:24:16 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:17.235786 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2622f128-c1f2-49d1-a08e-be7ca569a6c6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:17.236416 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2622f128-c1f2-49d1-a08e-be7ca569a6c6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:17.243721 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2622f128-c1f2-49d1-a08e-be7ca569a6c6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:17.244182 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2622f128-c1f2-49d1-a08e-be7ca569a6c6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:17.244973 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2622f128-c1f2-49d1-a08e-be7ca569a6c6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:17.245452 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2622f128-c1f2-49d1-a08e-be7ca569a6c6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:17.385668 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2622f128-c1f2-49d1-a08e-be7ca569a6c6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:17.394557 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2622f128-c1f2-49d1-a08e-be7ca569a6c6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1548 microversion: 2.1 time: 0.163149 Jul 04 09:24:17.395464 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 346/684] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:17 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:17.411118 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-22aaf2ce-3b66-4766-ace8-aa33569e29ec tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:17.411721 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-22aaf2ce-3b66-4766-ace8-aa33569e29ec tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:17.418350 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22aaf2ce-3b66-4766-ace8-aa33569e29ec tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:17.418854 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22aaf2ce-3b66-4766-ace8-aa33569e29ec tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:17.419665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22aaf2ce-3b66-4766-ace8-aa33569e29ec tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:17.420084 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-22aaf2ce-3b66-4766-ace8-aa33569e29ec tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:17.444984 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b3b99453-b3f9-4385-ac84-b75d1dd2732c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:17.445630 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b3b99453-b3f9-4385-ac84-b75d1dd2732c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:17.452652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b3b99453-b3f9-4385-ac84-b75d1dd2732c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:17.453142 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b3b99453-b3f9-4385-ac84-b75d1dd2732c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:17.453944 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b3b99453-b3f9-4385-ac84-b75d1dd2732c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:17.454622 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b3b99453-b3f9-4385-ac84-b75d1dd2732c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:17.716487 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-22aaf2ce-3b66-4766-ace8-aa33569e29ec tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.308575 Jul 04 09:24:17.717493 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 339/685] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 4 09:24:17 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-interface => generated 284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:17.722236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-58ea3b1e-79d8-4461-a2e1-d9ae1c712001 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:17.723291 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-58ea3b1e-79d8-4461-a2e1-d9ae1c712001 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:17.737453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58ea3b1e-79d8-4461-a2e1-d9ae1c712001 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:17.737926 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58ea3b1e-79d8-4461-a2e1-d9ae1c712001 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:17.738730 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58ea3b1e-79d8-4461-a2e1-d9ae1c712001 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:17.739227 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58ea3b1e-79d8-4461-a2e1-d9ae1c712001 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:17.773199 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-58ea3b1e-79d8-4461-a2e1-d9ae1c712001 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054571 Jul 04 09:24:17.773787 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 340/686] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:24:17 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:17.784001 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b3b99453-b3f9-4385-ac84-b75d1dd2732c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:17.792061 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b3b99453-b3f9-4385-ac84-b75d1dd2732c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.350940 Jul 04 09:24:17.792711 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 347/687] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:17 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:18.687180 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-e32c7870-e34c-4116-ab01-10de9af1e45a req-31be81f1-b27f-4b3c-8c60-c7be6610b1be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf3ecbe-ac29-4c45-a385-f8fa5c699e5d", "tag": "fd94d403-49cf-477b-9ae8-84dc8eff0d60"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:18.690548 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:18.696777 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-e32c7870-e34c-4116-ab01-10de9af1e45a req-31be81f1-b27f-4b3c-8c60-c7be6610b1be service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:18.697255 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-e32c7870-e34c-4116-ab01-10de9af1e45a req-31be81f1-b27f-4b3c-8c60-c7be6610b1be service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:18.710375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-e32c7870-e34c-4116-ab01-10de9af1e45a req-31be81f1-b27f-4b3c-8c60-c7be6610b1be service nova] Creating event network-changed:fd94d403-49cf-477b-9ae8-84dc8eff0d60 for instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d on hv-cinder-84456 Jul 04 09:24:18.716378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-e32c7870-e34c-4116-ab01-10de9af1e45a req-31be81f1-b27f-4b3c-8c60-c7be6610b1be service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032614 Jul 04 09:24:18.717834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 341/688] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:18.785811 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f74160da-81b9-47b8-aca3-159e923c1cad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:18.786750 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f74160da-81b9-47b8-aca3-159e923c1cad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:18.794726 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f74160da-81b9-47b8-aca3-159e923c1cad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:18.795187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f74160da-81b9-47b8-aca3-159e923c1cad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:18.795977 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f74160da-81b9-47b8-aca3-159e923c1cad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:18.796418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f74160da-81b9-47b8-aca3-159e923c1cad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:18.812967 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0b814901-b49b-4bae-810e-97bba2cdd492 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:18.813954 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0b814901-b49b-4bae-810e-97bba2cdd492 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:18.829704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b814901-b49b-4bae-810e-97bba2cdd492 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:18.830304 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b814901-b49b-4bae-810e-97bba2cdd492 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:18.832492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b814901-b49b-4bae-810e-97bba2cdd492 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:18.839327 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0b814901-b49b-4bae-810e-97bba2cdd492 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:18.842407 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f74160da-81b9-47b8-aca3-159e923c1cad tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060263 Jul 04 09:24:18.843460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 348/689] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:24:18 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:19.023034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0b814901-b49b-4bae-810e-97bba2cdd492 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:19.032415 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0b814901-b49b-4bae-810e-97bba2cdd492 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.227496 Jul 04 09:24:19.033141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 342/690] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:18 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:19.152086 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bd32bdc7-4c7e-4a02-a999-1f26cd39e984 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:19.152622 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bd32bdc7-4c7e-4a02-a999-1f26cd39e984 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:19.159434 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd32bdc7-4c7e-4a02-a999-1f26cd39e984 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:19.159893 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd32bdc7-4c7e-4a02-a999-1f26cd39e984 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:19.160676 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd32bdc7-4c7e-4a02-a999-1f26cd39e984 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:19.161150 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd32bdc7-4c7e-4a02-a999-1f26cd39e984 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:19.314356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bd32bdc7-4c7e-4a02-a999-1f26cd39e984 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:19.323536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bd32bdc7-4c7e-4a02-a999-1f26cd39e984 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1594 microversion: 2.1 time: 0.175332 Jul 04 09:24:19.325398 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 349/691] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:19 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1594 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:19.855747 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f5465edc-bbd4-41f7-9f5a-5b4ecf0f7fe0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:19.858345 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f5465edc-bbd4-41f7-9f5a-5b4ecf0f7fe0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:19.866524 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5465edc-bbd4-41f7-9f5a-5b4ecf0f7fe0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:19.867257 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5465edc-bbd4-41f7-9f5a-5b4ecf0f7fe0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:19.868413 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5465edc-bbd4-41f7-9f5a-5b4ecf0f7fe0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:19.871216 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5465edc-bbd4-41f7-9f5a-5b4ecf0f7fe0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:19.914284 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f5465edc-bbd4-41f7-9f5a-5b4ecf0f7fe0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063896 Jul 04 09:24:19.915097 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 343/692] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:24:19 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:24:19.994292 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-89daf9de-fe61-4098-b592-d5bc6d9e06ef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:19.995506 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-89daf9de-fe61-4098-b592-d5bc6d9e06ef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:20.004452 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89daf9de-fe61-4098-b592-d5bc6d9e06ef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.005178 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89daf9de-fe61-4098-b592-d5bc6d9e06ef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.006012 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89daf9de-fe61-4098-b592-d5bc6d9e06ef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.006458 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-89daf9de-fe61-4098-b592-d5bc6d9e06ef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.039144 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-89daf9de-fe61-4098-b592-d5bc6d9e06ef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:24:20.050461 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b820ed52-819d-4164-8cc4-2e5f4fc5cc0a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:20.051088 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b820ed52-819d-4164-8cc4-2e5f4fc5cc0a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:20.069237 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b820ed52-819d-4164-8cc4-2e5f4fc5cc0a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.069703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b820ed52-819d-4164-8cc4-2e5f4fc5cc0a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.070498 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b820ed52-819d-4164-8cc4-2e5f4fc5cc0a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.070949 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b820ed52-819d-4164-8cc4-2e5f4fc5cc0a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.152966 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-89daf9de-fe61-4098-b592-d5bc6d9e06ef tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 204 len: 0 microversion: 2.1 time: 0.162483 Jul 04 09:24:20.155224 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 350/693] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:24:19 2022] DELETE /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:24:20.163842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0de1446a-4fc8-491a-898f-e0148b9e29fe tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:20.164536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0de1446a-4fc8-491a-898f-e0148b9e29fe tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:20.171218 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0de1446a-4fc8-491a-898f-e0148b9e29fe tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.171665 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0de1446a-4fc8-491a-898f-e0148b9e29fe tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.172426 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0de1446a-4fc8-491a-898f-e0148b9e29fe tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:20.172890 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0de1446a-4fc8-491a-898f-e0148b9e29fe tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:20.405368 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b820ed52-819d-4164-8cc4-2e5f4fc5cc0a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:20.413352 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b820ed52-819d-4164-8cc4-2e5f4fc5cc0a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.366655 Jul 04 09:24:20.413919 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 344/694] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:20 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:20.500379 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0de1446a-4fc8-491a-898f-e0148b9e29fe tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:20.508031 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0de1446a-4fc8-491a-898f-e0148b9e29fe tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1679 microversion: 2.1 time: 0.348220 Jul 04 09:24:20.508606 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 351/695] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:20 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1679 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:21.355972 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-58ff423f-80e1-46b5-8c11-5e791e274c32 req-46c8504f-b340-4b4d-b21c-f98cb80772eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c288bc0-6da5-4db1-81a5-6a2122dcd793", "tag": "ba329408-a9df-4565-8cdc-da224a105d5c"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:21.367030 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-58ff423f-80e1-46b5-8c11-5e791e274c32 req-46c8504f-b340-4b4d-b21c-f98cb80772eb service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.367487 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-58ff423f-80e1-46b5-8c11-5e791e274c32 req-46c8504f-b340-4b4d-b21c-f98cb80772eb service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.396055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-58ff423f-80e1-46b5-8c11-5e791e274c32 req-46c8504f-b340-4b4d-b21c-f98cb80772eb service nova] Creating event network-changed:ba329408-a9df-4565-8cdc-da224a105d5c for instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 on hv-cinder-84456 Jul 04 09:24:21.401446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-58ff423f-80e1-46b5-8c11-5e791e274c32 req-46c8504f-b340-4b4d-b21c-f98cb80772eb service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049052 Jul 04 09:24:21.402240 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 345/696] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:21.430877 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c0d0e8fc-11b3-4eb8-82b7-985d6cbf6eb4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:21.431537 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c0d0e8fc-11b3-4eb8-82b7-985d6cbf6eb4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:21.439433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c0d0e8fc-11b3-4eb8-82b7-985d6cbf6eb4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.439893 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c0d0e8fc-11b3-4eb8-82b7-985d6cbf6eb4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.440901 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c0d0e8fc-11b3-4eb8-82b7-985d6cbf6eb4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.441632 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c0d0e8fc-11b3-4eb8-82b7-985d6cbf6eb4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.528480 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-35d7e8d7-df9f-40ad-966f-d99b45b2d8bd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:21.529619 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-35d7e8d7-df9f-40ad-966f-d99b45b2d8bd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:21.556763 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35d7e8d7-df9f-40ad-966f-d99b45b2d8bd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.556763 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35d7e8d7-df9f-40ad-966f-d99b45b2d8bd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.561924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35d7e8d7-df9f-40ad-966f-d99b45b2d8bd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:21.562577 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35d7e8d7-df9f-40ad-966f-d99b45b2d8bd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:21.655872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c0d0e8fc-11b3-4eb8-82b7-985d6cbf6eb4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:21.666842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c0d0e8fc-11b3-4eb8-82b7-985d6cbf6eb4 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.239998 Jul 04 09:24:21.679156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 352/697] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:21 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:21.741541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-35d7e8d7-df9f-40ad-966f-d99b45b2d8bd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:21.750296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-35d7e8d7-df9f-40ad-966f-d99b45b2d8bd tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1679 microversion: 2.1 time: 0.228311 Jul 04 09:24:21.751028 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 346/698] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:21 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:22.687692 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-938ecfa9-2b65-4cf7-821f-81fb4aeb1327 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:22.688461 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-938ecfa9-2b65-4cf7-821f-81fb4aeb1327 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:22.691169 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:22.696218 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-938ecfa9-2b65-4cf7-821f-81fb4aeb1327 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:22.696955 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-938ecfa9-2b65-4cf7-821f-81fb4aeb1327 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:22.698060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-938ecfa9-2b65-4cf7-821f-81fb4aeb1327 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:22.698654 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-938ecfa9-2b65-4cf7-821f-81fb4aeb1327 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:22.768320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-31023485-2b77-401e-9114-61e925da74f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:22.768927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-31023485-2b77-401e-9114-61e925da74f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:22.775713 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=84 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:22.777708 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-31023485-2b77-401e-9114-61e925da74f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:22.778819 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-31023485-2b77-401e-9114-61e925da74f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:22.779816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-31023485-2b77-401e-9114-61e925da74f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:22.780294 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-31023485-2b77-401e-9114-61e925da74f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:22.929982 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-938ecfa9-2b65-4cf7-821f-81fb4aeb1327 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:22.939286 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-938ecfa9-2b65-4cf7-821f-81fb4aeb1327 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.256447 Jul 04 09:24:22.940027 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 353/699] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:22 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:22.948272 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-60691a06-810c-4fdd-bff4-a0a5a637c7d6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-10137894"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:22.948272 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-60691a06-810c-4fdd-bff4-a0a5a637c7d6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:22.953382 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-60691a06-810c-4fdd-bff4-a0a5a637c7d6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:22.953993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-60691a06-810c-4fdd-bff4-a0a5a637c7d6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:22.954892 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-60691a06-810c-4fdd-bff4-a0a5a637c7d6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:22.955439 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-60691a06-810c-4fdd-bff4-a0a5a637c7d6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:22.960450 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-31023485-2b77-401e-9114-61e925da74f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:22.970754 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-31023485-2b77-401e-9114-61e925da74f8 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 200 len: 1679 microversion: 2.1 time: 0.206316 Jul 04 09:24:22.970948 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:22.971667 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 347/700] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:22 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:23.096354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.network.security_group_api [None req-60691a06-810c-4fdd-bff4-a0a5a637c7d6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Adding security group 4218613c-a5b5-48f9-8c51-e48a7b43c071 to port ba329408-a9df-4565-8cdc-da224a105d5c Jul 04 09:24:23.405265 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-37eda092-79e9-4e0a-af41-9d640790eebf req-fb496e36-a2f7-4537-bd03-c48cb2bb5ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63068e8d-61aa-4db4-aa29-b3b179933ba9", "name": "network-vif-deleted", "tag": "6bbe12ec-8feb-466a-93b3-661859e34233"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:23.415591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-37eda092-79e9-4e0a-af41-9d640790eebf req-fb496e36-a2f7-4537-bd03-c48cb2bb5ee8 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:23.416172 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-37eda092-79e9-4e0a-af41-9d640790eebf req-fb496e36-a2f7-4537-bd03-c48cb2bb5ee8 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:23.442062 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-37eda092-79e9-4e0a-af41-9d640790eebf req-fb496e36-a2f7-4537-bd03-c48cb2bb5ee8 service nova] Creating event network-vif-deleted:6bbe12ec-8feb-466a-93b3-661859e34233 for instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 on hv-cinder-84456 Jul 04 09:24:23.447958 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-37eda092-79e9-4e0a-af41-9d640790eebf req-fb496e36-a2f7-4537-bd03-c48cb2bb5ee8 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047855 Jul 04 09:24:23.452053 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 348/701] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:24:23.769163 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-60691a06-810c-4fdd-bff4-a0a5a637c7d6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "POST /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/action" status: 202 len: 0 microversion: 2.1 time: 0.827897 Jul 04 09:24:23.771412 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 354/702] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:24:22 2022] POST /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:24:23.779962 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fafc1158-2f42-4778-9667-c1920a5c58ad tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:23.781932 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fafc1158-2f42-4778-9667-c1920a5c58ad tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:23.789512 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-af28807f-68a1-42cd-bfa7-a9e5d486f40b req-83185ab3-cf15-4687-9acd-c94d27043862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c288bc0-6da5-4db1-81a5-6a2122dcd793", "tag": "ba329408-a9df-4565-8cdc-da224a105d5c"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:23.798314 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fafc1158-2f42-4778-9667-c1920a5c58ad tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:23.802455 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fafc1158-2f42-4778-9667-c1920a5c58ad tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:23.805778 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fafc1158-2f42-4778-9667-c1920a5c58ad tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:23.808589 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-af28807f-68a1-42cd-bfa7-a9e5d486f40b req-83185ab3-cf15-4687-9acd-c94d27043862 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:23.810125 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fafc1158-2f42-4778-9667-c1920a5c58ad tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:23.816340 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-af28807f-68a1-42cd-bfa7-a9e5d486f40b req-83185ab3-cf15-4687-9acd-c94d27043862 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:23.842565 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-af28807f-68a1-42cd-bfa7-a9e5d486f40b req-83185ab3-cf15-4687-9acd-c94d27043862 service nova] Creating event network-changed:ba329408-a9df-4565-8cdc-da224a105d5c for instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 on hv-cinder-84456 Jul 04 09:24:23.853935 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-af28807f-68a1-42cd-bfa7-a9e5d486f40b req-83185ab3-cf15-4687-9acd-c94d27043862 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067885 Jul 04 09:24:23.858845 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 355/703] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:24:23.958164 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5184a51f-8d5d-4544-89c0-3c5a735a7a66 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:23.958875 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5184a51f-8d5d-4544-89c0-3c5a735a7a66 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:23.968844 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5184a51f-8d5d-4544-89c0-3c5a735a7a66 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:23.969331 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5184a51f-8d5d-4544-89c0-3c5a735a7a66 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:23.970195 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5184a51f-8d5d-4544-89c0-3c5a735a7a66 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:23.982867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5184a51f-8d5d-4544-89c0-3c5a735a7a66 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:24.030394 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:24:24.031420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Mon Jul 4 09:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 (ip 10.222.0.71) !!! Jul 04 09:24:24.116296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fafc1158-2f42-4778-9667-c1920a5c58ad tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:24.126691 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fafc1158-2f42-4778-9667-c1920a5c58ad tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1757 microversion: 2.1 time: 0.351143 Jul 04 09:24:24.132458 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 349/704] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:23 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1757 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:24.138123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5b8a5f8e-bff6-40c7-9a37-e7f0810fccd3 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:24.138979 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5b8a5f8e-bff6-40c7-9a37-e7f0810fccd3 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:24.145777 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b8a5f8e-bff6-40c7-9a37-e7f0810fccd3 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:24.146459 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b8a5f8e-bff6-40c7-9a37-e7f0810fccd3 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:24.147431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b8a5f8e-bff6-40c7-9a37-e7f0810fccd3 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:24.148034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5b8a5f8e-bff6-40c7-9a37-e7f0810fccd3 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:24.164249 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-5b8a5f8e-bff6-40c7-9a37-e7f0810fccd3 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5b8a5f8e-bff6-40c7-9a37-e7f0810fccd3 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 HTTP/1.1 Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:24:24.166412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:24:24.167872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '63068e8d-61aa-4db4-aa29-b3b179933ba9'} Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:24:24.168897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:24:24.170320 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:24.172352 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5b8a5f8e-bff6-40c7-9a37-e7f0810fccd3 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:24:24.173423 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5b8a5f8e-bff6-40c7-9a37-e7f0810fccd3 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 404 len: 111 microversion: 2.1 time: 0.039789 Jul 04 09:24:24.174164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 350/705] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:24 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:24:24.182816 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5184a51f-8d5d-4544-89c0-3c5a735a7a66 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:24.185895 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c5684678-ada9-42c1-9398-3920beb6dc09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '.version_select at 0x7fad7a9545e0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:24.191809 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5184a51f-8d5d-4544-89c0-3c5a735a7a66 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.239395 Jul 04 09:24:24.197407 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 356/706] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:23 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:24.208001 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c5684678-ada9-42c1-9398-3920beb6dc09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-853270730" status: 202 len: 0 microversion: 2.1 time: 0.029046 Jul 04 09:24:24.208872 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 351/707] 10.222.0.71 () {58 vars in 1217 bytes} [Mon Jul 4 09:24:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-853270730 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:24:24.878198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-57bd75ca-eba2-4a95-97a5-b3a41573e500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: .version_select at 0x7fad7aadbee0>, body: {"keypair": {"name": "tempest-keypair-476296475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdeAV35Kfq/lfLxYpE738TR/6IL/62hKsKksHhGs9qFa00YuLWsxjv4vRkFYDGcaqTe1YyzmT1/gtCzs/9tErxuyVLP3fnbHxephA46MVPvvkeoVEo8JtXKINzKRphtxQ=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:24.893870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-57bd75ca-eba2-4a95-97a5-b3a41573e500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for project ba157b0e49f1447e82755035db8728d5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:24:24.897820 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-57bd75ca-eba2-4a95-97a5-b3a41573e500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for user 6bc30b7d536444008e5b5bab45c5c438 and project ba157b0e49f1447e82755035db8728d5. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:24:24.919535 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-57bd75ca-eba2-4a95-97a5-b3a41573e500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045002 Jul 04 09:24:24.920134 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 357/708] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 4 09:24:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:25.212442 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-253b7aa4-b44e-4c54-95eb-88265eb4a754 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:25.213170 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-253b7aa4-b44e-4c54-95eb-88265eb4a754 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:25.222864 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-253b7aa4-b44e-4c54-95eb-88265eb4a754 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:25.223753 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-253b7aa4-b44e-4c54-95eb-88265eb4a754 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:25.224810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-253b7aa4-b44e-4c54-95eb-88265eb4a754 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:25.225675 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-253b7aa4-b44e-4c54-95eb-88265eb4a754 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:25.495957 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-253b7aa4-b44e-4c54-95eb-88265eb4a754 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:25.504419 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-253b7aa4-b44e-4c54-95eb-88265eb4a754 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.298018 Jul 04 09:24:25.504987 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 352/709] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:25 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:26.410003 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-788681958", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "599dfd4b-618e-4261-9f6d-462c4cc71e5b"}], "security_groups": [{"name": "tempest-securitygroup--288920456"}], "key_name": "tempest-keypair-476296475", "user_data": "}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:26.511566 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] validate_networks() for [('599dfd4b-618e-4261-9f6d-462c4cc71e5b', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:24:26.521784 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9fefdf93-4e68-4c38-9d70-aa109d00a11a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:26.522495 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9fefdf93-4e68-4c38-9d70-aa109d00a11a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:26.529369 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9fefdf93-4e68-4c38-9d70-aa109d00a11a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:26.529824 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9fefdf93-4e68-4c38-9d70-aa109d00a11a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:26.530603 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9fefdf93-4e68-4c38-9d70-aa109d00a11a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:26.531048 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9fefdf93-4e68-4c38-9d70-aa109d00a11a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:26.741539 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9fefdf93-4e68-4c38-9d70-aa109d00a11a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:26.751253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9fefdf93-4e68-4c38-9d70-aa109d00a11a tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1735 microversion: 2.1 time: 0.233169 Jul 04 09:24:26.752045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 353/710] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:26 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:26.993023 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:24:26.993879 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:24:26.994363 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:24:26.994800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:24:26.995208 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:24:27.004231 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:27.004674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:27.005494 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:27.005930 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:27.023062 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for project ba157b0e49f1447e82755035db8728d5. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:24:27.027187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Getting quotas for user 6bc30b7d536444008e5b5bab45c5c438 and project ba157b0e49f1447e82755035db8728d5. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:24:27.039228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:24:27.041564 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:24:27.088825 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e04d17aa-0196-4afb-bf8c-44704693533d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.683565 Jul 04 09:24:27.089523 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 358/711] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:24:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 09:24:27.100599 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d6c8cfb2-a3c0-4cbc-9d3a-5d7c55dafeca tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:27.101345 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d6c8cfb2-a3c0-4cbc-9d3a-5d7c55dafeca tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:27.166517 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d6c8cfb2-a3c0-4cbc-9d3a-5d7c55dafeca tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:27.175674 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d6c8cfb2-a3c0-4cbc-9d3a-5d7c55dafeca tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1240 microversion: 2.1 time: 0.078914 Jul 04 09:24:27.176268 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 354/712] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:27 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:27.769294 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3ff6ed6d-1727-4e36-bafd-7313e2ffbe34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:27.769930 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-3ff6ed6d-1727-4e36-bafd-7313e2ffbe34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:27.777181 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3ff6ed6d-1727-4e36-bafd-7313e2ffbe34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:27.777735 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3ff6ed6d-1727-4e36-bafd-7313e2ffbe34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:27.779418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3ff6ed6d-1727-4e36-bafd-7313e2ffbe34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:27.779927 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-3ff6ed6d-1727-4e36-bafd-7313e2ffbe34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:27.912373 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-3ff6ed6d-1727-4e36-bafd-7313e2ffbe34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:27.921681 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3ff6ed6d-1727-4e36-bafd-7313e2ffbe34 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1715 microversion: 2.1 time: 0.156940 Jul 04 09:24:27.922240 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 359/713] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:27 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:28.026600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6ec4cb81-c0a7-4221-9afa-d01d922be6e3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:28.027161 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6ec4cb81-c0a7-4221-9afa-d01d922be6e3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:28.034329 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ec4cb81-c0a7-4221-9afa-d01d922be6e3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:28.034786 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ec4cb81-c0a7-4221-9afa-d01d922be6e3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:28.035556 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ec4cb81-c0a7-4221-9afa-d01d922be6e3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:28.036030 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6ec4cb81-c0a7-4221-9afa-d01d922be6e3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:28.119366 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-6ec4cb81-c0a7-4221-9afa-d01d922be6e3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] HTTP exception thrown: Cannot 'detach_volume' instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 while it is in vm_state rescued Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6ec4cb81-c0a7-4221-9afa-d01d922be6e3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Request method failure captured: Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments/7e2dd987-a6f5-4ec8-bb77-e9256de2af70 HTTP/1.1 Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrDhJYSHwF3c__Nm79ScElVeUrXw69YhZNVmCicWRkTgUemaIH6UCHrTozU63At60joHPj-AnQrcYts2Iq0IA300fd3mzUxkEJgxvJPXN8qcGqHH5u7Ysi8XWtim28KiG_KJzF-pFl1_km8X6MSzoELVi4rQJFJasNBPBAsoJBv4d6w Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 930dc66606e94d9eb82cc50a67d009fb Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:24:28.120893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_930dc66606e94d9eb82cc50a67d009fb", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 930dc66606e94d9eb82cc50a67d009fb Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-ServerRescueNegativeTestJSON-20151059-project Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 9bcf554f3d6447399e1d9cfe08b0bff7 Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-ServerRescueNegativeTestJSON-20151059-project Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:24:28.122834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Cannot 'detach_volume' instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 while it is in vm_state rescued Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'server_id': '80be812b-a9c3-4327-b55b-0dbcf97a12c7', 'id': '7e2dd987-a6f5-4ec8-bb77-e9256de2af70'} Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:24:28.123569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 while it is in vm_state rescued Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 while it is in vm_state rescued Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:24:28.124837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6ec4cb81-c0a7-4221-9afa-d01d922be6e3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Returning 409 to user: Cannot 'detach_volume' instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 while it is in vm_state rescued {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:24:28.126016 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6ec4cb81-c0a7-4221-9afa-d01d922be6e3 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "DELETE /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments/7e2dd987-a6f5-4ec8-bb77-e9256de2af70" status: 409 len: 152 microversion: 2.1 time: 0.100538 Jul 04 09:24:28.126250 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 355/714] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:24:28 2022] DELETE /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments/7e2dd987-a6f5-4ec8-bb77-e9256de2af70 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 04 09:24:28.132413 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9f3f8027-842e-49e0-bf98-3d7f45ded08f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:28.132960 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9f3f8027-842e-49e0-bf98-3d7f45ded08f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:28.139311 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f3f8027-842e-49e0-bf98-3d7f45ded08f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:28.139762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f3f8027-842e-49e0-bf98-3d7f45ded08f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:28.140553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f3f8027-842e-49e0-bf98-3d7f45ded08f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:28.140993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9f3f8027-842e-49e0-bf98-3d7f45ded08f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:28.194008 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-730bf51a-5b14-4d76-9cf2-8ca4034f326f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:28.194655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-730bf51a-5b14-4d76-9cf2-8ca4034f326f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:28.201281 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-730bf51a-5b14-4d76-9cf2-8ca4034f326f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:28.201731 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-730bf51a-5b14-4d76-9cf2-8ca4034f326f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:28.202542 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-730bf51a-5b14-4d76-9cf2-8ca4034f326f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:28.202944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-730bf51a-5b14-4d76-9cf2-8ca4034f326f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:28.223331 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9f3f8027-842e-49e0-bf98-3d7f45ded08f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "POST /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/action" status: 202 len: 0 microversion: 2.1 time: 0.094717 Jul 04 09:24:28.224242 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 360/715] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:24:28 2022] POST /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:24:28.246158 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5d564a44-49f9-4f59-a099-79652cf2710d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:28.248083 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5d564a44-49f9-4f59-a099-79652cf2710d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:28.259580 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d564a44-49f9-4f59-a099-79652cf2710d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:28.260868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d564a44-49f9-4f59-a099-79652cf2710d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:28.261125 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d564a44-49f9-4f59-a099-79652cf2710d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:28.261601 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d564a44-49f9-4f59-a099-79652cf2710d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:28.276704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-730bf51a-5b14-4d76-9cf2-8ca4034f326f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:28.286458 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-730bf51a-5b14-4d76-9cf2-8ca4034f326f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1300 microversion: 2.1 time: 0.094869 Jul 04 09:24:28.287246 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 356/716] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:28 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:28.416545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d564a44-49f9-4f59-a099-79652cf2710d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:28.427849 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5d564a44-49f9-4f59-a099-79652cf2710d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1723 microversion: 2.1 time: 0.199144 Jul 04 09:24:28.428960 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 361/717] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:28 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:29.306434 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c7bc7480-d9c6-4af9-8c12-3c5c710e287b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:29.307053 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c7bc7480-d9c6-4af9-8c12-3c5c710e287b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:29.315315 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7bc7480-d9c6-4af9-8c12-3c5c710e287b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:29.315807 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7bc7480-d9c6-4af9-8c12-3c5c710e287b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:29.316596 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7bc7480-d9c6-4af9-8c12-3c5c710e287b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:29.317065 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7bc7480-d9c6-4af9-8c12-3c5c710e287b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:29.321595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:29.383854 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c7bc7480-d9c6-4af9-8c12-3c5c710e287b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:29.392888 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c7bc7480-d9c6-4af9-8c12-3c5c710e287b tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1298 microversion: 2.1 time: 0.090367 Jul 04 09:24:29.393745 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 357/718] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:29 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:29.452252 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4e011e80-0a70-4284-9663-8105042126bc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:29.452884 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4e011e80-0a70-4284-9663-8105042126bc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:29.460363 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e011e80-0a70-4284-9663-8105042126bc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:29.461213 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e011e80-0a70-4284-9663-8105042126bc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:29.462075 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e011e80-0a70-4284-9663-8105042126bc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:29.462522 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4e011e80-0a70-4284-9663-8105042126bc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:29.499514 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1291ebc3-a1c5-4ff3-a020-1e2a1b3952d5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:29.500041 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1291ebc3-a1c5-4ff3-a020-1e2a1b3952d5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:29.506759 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1291ebc3-a1c5-4ff3-a020-1e2a1b3952d5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:29.507281 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1291ebc3-a1c5-4ff3-a020-1e2a1b3952d5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:29.508243 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1291ebc3-a1c5-4ff3-a020-1e2a1b3952d5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:29.508697 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1291ebc3-a1c5-4ff3-a020-1e2a1b3952d5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:29.538078 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1291ebc3-a1c5-4ff3-a020-1e2a1b3952d5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/ips" status: 200 len: 153 microversion: 2.20 time: 0.111322 Jul 04 09:24:29.538763 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 362/719] 10.222.0.71 () {60 vars in 1288 bytes} [Mon Jul 4 09:24:29 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/ips => generated 153 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:24:29.621380 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4e011e80-0a70-4284-9663-8105042126bc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:29.628085 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4e011e80-0a70-4284-9663-8105042126bc tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1723 microversion: 2.1 time: 0.180401 Jul 04 09:24:29.629802 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 358/720] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:29 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:30.410104 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0f2ed36f-658f-4fe5-bafc-ff840aa4616f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:30.410719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0f2ed36f-658f-4fe5-bafc-ff840aa4616f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:30.416782 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0f2ed36f-658f-4fe5-bafc-ff840aa4616f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:30.417288 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0f2ed36f-658f-4fe5-bafc-ff840aa4616f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:30.418058 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0f2ed36f-658f-4fe5-bafc-ff840aa4616f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:30.418586 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0f2ed36f-658f-4fe5-bafc-ff840aa4616f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:30.550123 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0f2ed36f-658f-4fe5-bafc-ff840aa4616f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:30.557554 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0f2ed36f-658f-4fe5-bafc-ff840aa4616f tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1365 microversion: 2.1 time: 0.151380 Jul 04 09:24:30.558123 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 363/721] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:30 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:30.646270 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-122fa6cf-13d2-4956-adcd-56a9c20def92 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:30.646884 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-122fa6cf-13d2-4956-adcd-56a9c20def92 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:30.654084 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-122fa6cf-13d2-4956-adcd-56a9c20def92 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:30.654540 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-122fa6cf-13d2-4956-adcd-56a9c20def92 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:30.655315 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-122fa6cf-13d2-4956-adcd-56a9c20def92 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:30.655756 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-122fa6cf-13d2-4956-adcd-56a9c20def92 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:30.788310 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-122fa6cf-13d2-4956-adcd-56a9c20def92 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:30.796474 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-122fa6cf-13d2-4956-adcd-56a9c20def92 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1723 microversion: 2.1 time: 0.154035 Jul 04 09:24:30.797061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 359/722] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:30 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:31.354241 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-c9d1fa45-7bd0-4727-a62e-02823e784c46 req-62acf50f-2881-4c91-8993-903cab2ff307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ac9e1b-d4ff-4388-80ae-856b12ae84c5", "tag": "ae0b093c-f317-43f2-bb12-0e0dc232b669"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:31.364071 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c9d1fa45-7bd0-4727-a62e-02823e784c46 req-62acf50f-2881-4c91-8993-903cab2ff307 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:31.364811 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c9d1fa45-7bd0-4727-a62e-02823e784c46 req-62acf50f-2881-4c91-8993-903cab2ff307 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:31.377924 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-c9d1fa45-7bd0-4727-a62e-02823e784c46 req-62acf50f-2881-4c91-8993-903cab2ff307 service nova] Creating event network-changed:ae0b093c-f317-43f2-bb12-0e0dc232b669 for instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 on hv-cinder-84456 Jul 04 09:24:31.384826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-c9d1fa45-7bd0-4727-a62e-02823e784c46 req-62acf50f-2881-4c91-8993-903cab2ff307 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032636 Jul 04 09:24:31.384826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 364/723] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:31.574911 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8c38a3ef-1028-4132-8909-1c29956e2682 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:31.575489 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8c38a3ef-1028-4132-8909-1c29956e2682 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:31.582628 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8c38a3ef-1028-4132-8909-1c29956e2682 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:31.583078 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8c38a3ef-1028-4132-8909-1c29956e2682 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:31.583834 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8c38a3ef-1028-4132-8909-1c29956e2682 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:31.584265 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8c38a3ef-1028-4132-8909-1c29956e2682 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:31.815517 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7f53b7d0-4480-4816-a047-aff49d9b1a81 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:31.816881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7f53b7d0-4480-4816-a047-aff49d9b1a81 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:31.823399 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f53b7d0-4480-4816-a047-aff49d9b1a81 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:31.823850 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f53b7d0-4480-4816-a047-aff49d9b1a81 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:31.824659 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f53b7d0-4480-4816-a047-aff49d9b1a81 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:31.825178 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7f53b7d0-4480-4816-a047-aff49d9b1a81 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:31.907798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8c38a3ef-1028-4132-8909-1c29956e2682 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:31.915470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8c38a3ef-1028-4132-8909-1c29956e2682 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1365 microversion: 2.1 time: 0.344402 Jul 04 09:24:31.916031 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 360/724] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:31 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1365 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:31.971650 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-eff67cac-1bf9-4f34-a3fd-63cb4b59c569 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:31.972278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-eff67cac-1bf9-4f34-a3fd-63cb4b59c569 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:31.978494 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eff67cac-1bf9-4f34-a3fd-63cb4b59c569 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:31.978944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eff67cac-1bf9-4f34-a3fd-63cb4b59c569 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:31.979711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eff67cac-1bf9-4f34-a3fd-63cb4b59c569 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:31.980144 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-eff67cac-1bf9-4f34-a3fd-63cb4b59c569 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:31.986191 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7f53b7d0-4480-4816-a047-aff49d9b1a81 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:31.994390 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7f53b7d0-4480-4816-a047-aff49d9b1a81 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1729 microversion: 2.1 time: 0.184488 Jul 04 09:24:31.995030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 365/725] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:31 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:32.004365 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-eff67cac-1bf9-4f34-a3fd-63cb4b59c569 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lazy-loading 'flavor' on Instance uuid fc1af165-f9ff-409d-a80d-0998b4f545d9 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:24:32.011320 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-98be508e-cbe5-467b-864b-87d3d8c3c0a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:32.012108 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-98be508e-cbe5-467b-864b-87d3d8c3c0a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:32.018423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-98be508e-cbe5-467b-864b-87d3d8c3c0a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:32.019135 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-98be508e-cbe5-467b-864b-87d3d8c3c0a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:32.020112 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-98be508e-cbe5-467b-864b-87d3d8c3c0a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:32.020771 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-98be508e-cbe5-467b-864b-87d3d8c3c0a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:32.105592 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-98be508e-cbe5-467b-864b-87d3d8c3c0a8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098020 Jul 04 09:24:32.106187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 366/726] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 4 09:24:32 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:24:32.280892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-eff67cac-1bf9-4f34-a3fd-63cb4b59c569 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "POST /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/action" status: 202 len: 0 microversion: 2.20 time: 0.313010 Jul 04 09:24:32.284942 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 361/727] 10.222.0.71 () {62 vars in 1318 bytes} [Mon Jul 4 09:24:31 2022] POST /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 04 09:24:32.290886 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fa9a76a4-afc2-4def-9ed1-e492d1bdf16e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:32.291761 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fa9a76a4-afc2-4def-9ed1-e492d1bdf16e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:32.299642 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa9a76a4-afc2-4def-9ed1-e492d1bdf16e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:32.300282 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa9a76a4-afc2-4def-9ed1-e492d1bdf16e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:32.301093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa9a76a4-afc2-4def-9ed1-e492d1bdf16e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:32.301725 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa9a76a4-afc2-4def-9ed1-e492d1bdf16e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:32.719797 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fa9a76a4-afc2-4def-9ed1-e492d1bdf16e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:32.727743 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fa9a76a4-afc2-4def-9ed1-e492d1bdf16e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:32.729300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fa9a76a4-afc2-4def-9ed1-e492d1bdf16e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:32.730620 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fa9a76a4-afc2-4def-9ed1-e492d1bdf16e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.444669 Jul 04 09:24:32.731191 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 367/728] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:32 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:32.934397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-35a979cf-15b6-4933-904b-388f3d4c9d4e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:32.935855 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-35a979cf-15b6-4933-904b-388f3d4c9d4e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:32.942478 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35a979cf-15b6-4933-904b-388f3d4c9d4e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:32.942933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35a979cf-15b6-4933-904b-388f3d4c9d4e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:32.943716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35a979cf-15b6-4933-904b-388f3d4c9d4e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:32.944145 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-35a979cf-15b6-4933-904b-388f3d4c9d4e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:33.151651 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-35a979cf-15b6-4933-904b-388f3d4c9d4e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:33.159178 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-35a979cf-15b6-4933-904b-388f3d4c9d4e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1365 microversion: 2.1 time: 0.229591 Jul 04 09:24:33.159768 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 362/729] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:32 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:33.320079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-77fbb190-86be-4d45-b396-9c731cc2c182 req-6a6194c1-cc04-4581-a670-6d99727a709f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80be812b-a9c3-4327-b55b-0dbcf97a12c7", "tag": "57ace4f7-2cc2-4fa1-b912-fdb4c747abf3"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:33.328922 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-77fbb190-86be-4d45-b396-9c731cc2c182 req-6a6194c1-cc04-4581-a670-6d99727a709f service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:33.332294 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-77fbb190-86be-4d45-b396-9c731cc2c182 req-6a6194c1-cc04-4581-a670-6d99727a709f service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:33.344623 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-77fbb190-86be-4d45-b396-9c731cc2c182 req-6a6194c1-cc04-4581-a670-6d99727a709f service nova] Creating event network-changed:57ace4f7-2cc2-4fa1-b912-fdb4c747abf3 for instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 on hv-cinder-84456 Jul 04 09:24:33.349631 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-77fbb190-86be-4d45-b396-9c731cc2c182 req-6a6194c1-cc04-4581-a670-6d99727a709f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033422 Jul 04 09:24:33.350308 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 368/730] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:33.748179 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-287fda27-42f5-458b-b351-17e61c91ae92 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:33.749168 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-287fda27-42f5-458b-b351-17e61c91ae92 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:33.755456 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-287fda27-42f5-458b-b351-17e61c91ae92 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:33.755916 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-287fda27-42f5-458b-b351-17e61c91ae92 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:33.756696 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-287fda27-42f5-458b-b351-17e61c91ae92 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:33.757161 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-287fda27-42f5-458b-b351-17e61c91ae92 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:33.906110 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-287fda27-42f5-458b-b351-17e61c91ae92 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:33.916529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-287fda27-42f5-458b-b351-17e61c91ae92 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:33.918683 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-287fda27-42f5-458b-b351-17e61c91ae92 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:33.919927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-287fda27-42f5-458b-b351-17e61c91ae92 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.175799 Jul 04 09:24:33.920685 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 363/731] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:33 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:34.176401 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8828e445-14cf-4c35-96fa-97cb45a364df tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:34.177333 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8828e445-14cf-4c35-96fa-97cb45a364df tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:34.187965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8828e445-14cf-4c35-96fa-97cb45a364df tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:34.188438 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8828e445-14cf-4c35-96fa-97cb45a364df tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:34.189261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8828e445-14cf-4c35-96fa-97cb45a364df tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:34.189698 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8828e445-14cf-4c35-96fa-97cb45a364df tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:34.331637 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8828e445-14cf-4c35-96fa-97cb45a364df tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:34.339760 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8828e445-14cf-4c35-96fa-97cb45a364df tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1365 microversion: 2.1 time: 0.167605 Jul 04 09:24:34.340433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 369/732] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:34 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:34.939552 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5da083e0-2dcc-4cc1-ab78-b3c0c6f4504b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:34.940156 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5da083e0-2dcc-4cc1-ab78-b3c0c6f4504b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:34.946916 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5da083e0-2dcc-4cc1-ab78-b3c0c6f4504b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:34.947378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5da083e0-2dcc-4cc1-ab78-b3c0c6f4504b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:34.948146 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5da083e0-2dcc-4cc1-ab78-b3c0c6f4504b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:34.948592 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5da083e0-2dcc-4cc1-ab78-b3c0c6f4504b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:35.099685 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5da083e0-2dcc-4cc1-ab78-b3c0c6f4504b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:35.113923 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5da083e0-2dcc-4cc1-ab78-b3c0c6f4504b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:35.115593 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5da083e0-2dcc-4cc1-ab78-b3c0c6f4504b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:35.117279 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5da083e0-2dcc-4cc1-ab78-b3c0c6f4504b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.182197 Jul 04 09:24:35.117841 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 364/733] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:34 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:35.357739 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c5eb1475-d6b0-4cf0-b25e-5060b00befbf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:35.358365 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c5eb1475-d6b0-4cf0-b25e-5060b00befbf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:35.363388 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-2ac94404-cac6-4d7c-bca3-8ae5b12aea9e req-11bc4770-2a27-49bc-8a29-8c0a5cd3680f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80be812b-a9c3-4327-b55b-0dbcf97a12c7", "tag": "57ace4f7-2cc2-4fa1-b912-fdb4c747abf3"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:35.365352 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c5eb1475-d6b0-4cf0-b25e-5060b00befbf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:35.365811 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c5eb1475-d6b0-4cf0-b25e-5060b00befbf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:35.367062 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c5eb1475-d6b0-4cf0-b25e-5060b00befbf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:35.367195 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c5eb1475-d6b0-4cf0-b25e-5060b00befbf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:35.371808 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-2ac94404-cac6-4d7c-bca3-8ae5b12aea9e req-11bc4770-2a27-49bc-8a29-8c0a5cd3680f service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:35.372275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-2ac94404-cac6-4d7c-bca3-8ae5b12aea9e req-11bc4770-2a27-49bc-8a29-8c0a5cd3680f service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:35.384552 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-2ac94404-cac6-4d7c-bca3-8ae5b12aea9e req-11bc4770-2a27-49bc-8a29-8c0a5cd3680f service nova] Creating event network-changed:57ace4f7-2cc2-4fa1-b912-fdb4c747abf3 for instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 on hv-cinder-84456 Jul 04 09:24:35.390877 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-2ac94404-cac6-4d7c-bca3-8ae5b12aea9e req-11bc4770-2a27-49bc-8a29-8c0a5cd3680f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031068 Jul 04 09:24:35.391833 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 365/734] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:35.500561 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c5eb1475-d6b0-4cf0-b25e-5060b00befbf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:35.508438 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c5eb1475-d6b0-4cf0-b25e-5060b00befbf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1365 microversion: 2.1 time: 0.154664 Jul 04 09:24:35.509199 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 370/735] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:35 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:36.136820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-139d079a-5070-4585-bb1b-dbdaac126d0d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:36.137485 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-139d079a-5070-4585-bb1b-dbdaac126d0d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:36.143917 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-139d079a-5070-4585-bb1b-dbdaac126d0d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:36.144375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-139d079a-5070-4585-bb1b-dbdaac126d0d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:36.145169 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-139d079a-5070-4585-bb1b-dbdaac126d0d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:36.145609 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-139d079a-5070-4585-bb1b-dbdaac126d0d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:36.281989 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-139d079a-5070-4585-bb1b-dbdaac126d0d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:36.289908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-139d079a-5070-4585-bb1b-dbdaac126d0d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:36.291421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-139d079a-5070-4585-bb1b-dbdaac126d0d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:36.292581 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-139d079a-5070-4585-bb1b-dbdaac126d0d tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.160623 Jul 04 09:24:36.293150 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 366/736] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:36 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:36.525878 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1314b3bf-cb6e-4883-8f1a-219924007581 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:36.526489 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1314b3bf-cb6e-4883-8f1a-219924007581 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:36.532979 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1314b3bf-cb6e-4883-8f1a-219924007581 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:36.533460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1314b3bf-cb6e-4883-8f1a-219924007581 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:36.534212 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1314b3bf-cb6e-4883-8f1a-219924007581 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:36.534645 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1314b3bf-cb6e-4883-8f1a-219924007581 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:36.665656 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1314b3bf-cb6e-4883-8f1a-219924007581 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:36.673847 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1314b3bf-cb6e-4883-8f1a-219924007581 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1365 microversion: 2.1 time: 0.151829 Jul 04 09:24:36.674413 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 371/737] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:36 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:37.117648 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-4cf33ba4-5962-448a-8596-870545ba9b76 req-a222b90c-a653-400b-879b-b85358880d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ac9e1b-d4ff-4388-80ae-856b12ae84c5", "name": "network-vif-plugged", "status": "completed", "tag": "ae0b093c-f317-43f2-bb12-0e0dc232b669"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:37.127007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-4cf33ba4-5962-448a-8596-870545ba9b76 req-a222b90c-a653-400b-879b-b85358880d56 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:37.127589 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-4cf33ba4-5962-448a-8596-870545ba9b76 req-a222b90c-a653-400b-879b-b85358880d56 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:37.139556 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-4cf33ba4-5962-448a-8596-870545ba9b76 req-a222b90c-a653-400b-879b-b85358880d56 service nova] Creating event network-vif-plugged:ae0b093c-f317-43f2-bb12-0e0dc232b669 for instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 on hv-cinder-84456 Jul 04 09:24:37.144815 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-4cf33ba4-5962-448a-8596-870545ba9b76 req-a222b90c-a653-400b-879b-b85358880d56 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030908 Jul 04 09:24:37.145462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 367/738] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:37.312450 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b613239d-97ee-40f1-8e9e-2b8d4d8db046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:37.313083 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b613239d-97ee-40f1-8e9e-2b8d4d8db046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:37.315049 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:37.315825 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=10 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:37.321724 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b613239d-97ee-40f1-8e9e-2b8d4d8db046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:37.322176 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b613239d-97ee-40f1-8e9e-2b8d4d8db046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:37.322951 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b613239d-97ee-40f1-8e9e-2b8d4d8db046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:37.323393 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b613239d-97ee-40f1-8e9e-2b8d4d8db046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:37.454959 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b613239d-97ee-40f1-8e9e-2b8d4d8db046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:37.462919 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b613239d-97ee-40f1-8e9e-2b8d4d8db046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:37.464423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b613239d-97ee-40f1-8e9e-2b8d4d8db046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:37.465790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b613239d-97ee-40f1-8e9e-2b8d4d8db046 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.158033 Jul 04 09:24:37.467136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 372/739] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:37 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:37.688105 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:37.692222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-fa9f27d2-9c9d-4edc-a0e6-8f3e22349f10 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:37.692914 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-fa9f27d2-9c9d-4edc-a0e6-8f3e22349f10 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:37.699384 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa9f27d2-9c9d-4edc-a0e6-8f3e22349f10 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:37.699833 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa9f27d2-9c9d-4edc-a0e6-8f3e22349f10 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:37.701067 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa9f27d2-9c9d-4edc-a0e6-8f3e22349f10 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:37.701525 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-fa9f27d2-9c9d-4edc-a0e6-8f3e22349f10 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:37.832591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-fa9f27d2-9c9d-4edc-a0e6-8f3e22349f10 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:37.840024 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-fa9f27d2-9c9d-4edc-a0e6-8f3e22349f10 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1365 microversion: 2.1 time: 0.152883 Jul 04 09:24:37.840589 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 368/740] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:37 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:38.484493 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ea82c198-32f3-47a8-af3c-cd897294113a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:38.485152 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ea82c198-32f3-47a8-af3c-cd897294113a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:38.491750 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea82c198-32f3-47a8-af3c-cd897294113a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:38.492208 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea82c198-32f3-47a8-af3c-cd897294113a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:38.492978 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea82c198-32f3-47a8-af3c-cd897294113a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:38.493449 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea82c198-32f3-47a8-af3c-cd897294113a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:38.625280 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ea82c198-32f3-47a8-af3c-cd897294113a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:38.633108 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ea82c198-32f3-47a8-af3c-cd897294113a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:38.634601 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ea82c198-32f3-47a8-af3c-cd897294113a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:38.635734 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ea82c198-32f3-47a8-af3c-cd897294113a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.155399 Jul 04 09:24:38.636288 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 373/741] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:38 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:38.859273 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1567bc94-05f6-4893-a265-0fac5d3c6d5a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:38.859883 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1567bc94-05f6-4893-a265-0fac5d3c6d5a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:38.866511 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1567bc94-05f6-4893-a265-0fac5d3c6d5a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:38.866960 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1567bc94-05f6-4893-a265-0fac5d3c6d5a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:38.867715 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1567bc94-05f6-4893-a265-0fac5d3c6d5a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:38.868151 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1567bc94-05f6-4893-a265-0fac5d3c6d5a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:38.999627 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1567bc94-05f6-4893-a265-0fac5d3c6d5a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:39.007204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1567bc94-05f6-4893-a265-0fac5d3c6d5a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1365 microversion: 2.1 time: 0.152488 Jul 04 09:24:39.007761 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 369/742] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:38 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:39.653388 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1cd99580-50fe-4b84-8f62-e95021af9373 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:39.654234 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1cd99580-50fe-4b84-8f62-e95021af9373 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:39.660641 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1cd99580-50fe-4b84-8f62-e95021af9373 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:39.661125 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1cd99580-50fe-4b84-8f62-e95021af9373 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:39.661901 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1cd99580-50fe-4b84-8f62-e95021af9373 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:39.662342 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1cd99580-50fe-4b84-8f62-e95021af9373 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:39.791441 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1cd99580-50fe-4b84-8f62-e95021af9373 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:39.793681 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:39.800920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1cd99580-50fe-4b84-8f62-e95021af9373 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:39.802487 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1cd99580-50fe-4b84-8f62-e95021af9373 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:39.803647 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1cd99580-50fe-4b84-8f62-e95021af9373 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.154326 Jul 04 09:24:39.804210 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 374/743] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:39 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:40.024215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-479bda84-77dd-4a4b-8934-bc6aea3184ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:40.024842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-479bda84-77dd-4a4b-8934-bc6aea3184ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:40.031580 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-479bda84-77dd-4a4b-8934-bc6aea3184ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:40.032043 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-479bda84-77dd-4a4b-8934-bc6aea3184ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:40.032821 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-479bda84-77dd-4a4b-8934-bc6aea3184ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:40.033298 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-479bda84-77dd-4a4b-8934-bc6aea3184ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:40.164117 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-479bda84-77dd-4a4b-8934-bc6aea3184ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:40.174609 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-479bda84-77dd-4a4b-8934-bc6aea3184ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1554 microversion: 2.1 time: 0.154272 Jul 04 09:24:40.175177 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 370/744] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:40 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:40.192789 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1fe6da97-0ba7-41db-8623-418315bf0b33 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:40.193306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1fe6da97-0ba7-41db-8623-418315bf0b33 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:40.199900 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1fe6da97-0ba7-41db-8623-418315bf0b33 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:40.200384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1fe6da97-0ba7-41db-8623-418315bf0b33 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:40.201347 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1fe6da97-0ba7-41db-8623-418315bf0b33 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:40.201785 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1fe6da97-0ba7-41db-8623-418315bf0b33 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:40.277547 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1fe6da97-0ba7-41db-8623-418315bf0b33 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089340 Jul 04 09:24:40.278138 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 375/745] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 4 09:24:40 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:24:40.822770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f62cda56-f6d0-4732-984e-21fd8bf08dff tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:40.823297 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f62cda56-f6d0-4732-984e-21fd8bf08dff tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:40.830197 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f62cda56-f6d0-4732-984e-21fd8bf08dff tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:40.830657 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f62cda56-f6d0-4732-984e-21fd8bf08dff tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:40.831421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f62cda56-f6d0-4732-984e-21fd8bf08dff tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:40.831861 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f62cda56-f6d0-4732-984e-21fd8bf08dff tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:41.045559 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f62cda56-f6d0-4732-984e-21fd8bf08dff tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:41.053817 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f62cda56-f6d0-4732-984e-21fd8bf08dff tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:41.055364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f62cda56-f6d0-4732-984e-21fd8bf08dff tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:41.056568 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f62cda56-f6d0-4732-984e-21fd8bf08dff tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.237925 Jul 04 09:24:41.057146 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 371/746] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:40 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:41.451222 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-49dadf00-34fb-4c66-b4f4-487be32ed2d5 req-ee95143e-c0ef-4262-8b0a-dffa9a2399e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ac9e1b-d4ff-4388-80ae-856b12ae84c5", "tag": "ae0b093c-f317-43f2-bb12-0e0dc232b669"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:41.459710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-49dadf00-34fb-4c66-b4f4-487be32ed2d5 req-ee95143e-c0ef-4262-8b0a-dffa9a2399e3 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:41.460162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-49dadf00-34fb-4c66-b4f4-487be32ed2d5 req-ee95143e-c0ef-4262-8b0a-dffa9a2399e3 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:41.471491 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-49dadf00-34fb-4c66-b4f4-487be32ed2d5 req-ee95143e-c0ef-4262-8b0a-dffa9a2399e3 service nova] Creating event network-changed:ae0b093c-f317-43f2-bb12-0e0dc232b669 for instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 on hv-cinder-84456 Jul 04 09:24:41.476276 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-49dadf00-34fb-4c66-b4f4-487be32ed2d5 req-ee95143e-c0ef-4262-8b0a-dffa9a2399e3 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030075 Jul 04 09:24:41.476879 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 376/747] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:42.075249 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-51e3d069-4dff-425f-a2ae-2104648509a8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:42.076131 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-51e3d069-4dff-425f-a2ae-2104648509a8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:42.082817 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-51e3d069-4dff-425f-a2ae-2104648509a8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:42.083375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-51e3d069-4dff-425f-a2ae-2104648509a8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:42.084166 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-51e3d069-4dff-425f-a2ae-2104648509a8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:42.084613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-51e3d069-4dff-425f-a2ae-2104648509a8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:42.220995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-51e3d069-4dff-425f-a2ae-2104648509a8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:42.228986 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-51e3d069-4dff-425f-a2ae-2104648509a8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:42.230528 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-51e3d069-4dff-425f-a2ae-2104648509a8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:42.232290 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-51e3d069-4dff-425f-a2ae-2104648509a8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.160527 Jul 04 09:24:42.233475 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 372/748] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:42 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:43.252180 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6b3b8871-f7f3-4ba9-a7a5-d3b11cbb3f13 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:43.252878 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6b3b8871-f7f3-4ba9-a7a5-d3b11cbb3f13 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:43.259127 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b3b8871-f7f3-4ba9-a7a5-d3b11cbb3f13 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:43.259582 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b3b8871-f7f3-4ba9-a7a5-d3b11cbb3f13 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:43.260343 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b3b8871-f7f3-4ba9-a7a5-d3b11cbb3f13 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:43.260784 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6b3b8871-f7f3-4ba9-a7a5-d3b11cbb3f13 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:43.391590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6b3b8871-f7f3-4ba9-a7a5-d3b11cbb3f13 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:43.399649 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6b3b8871-f7f3-4ba9-a7a5-d3b11cbb3f13 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:43.401200 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6b3b8871-f7f3-4ba9-a7a5-d3b11cbb3f13 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:43.402425 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6b3b8871-f7f3-4ba9-a7a5-d3b11cbb3f13 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.155693 Jul 04 09:24:43.402905 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 377/749] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:43 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:44.422123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7b59a185-47f7-4d83-9b3b-bbc5871488ab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:44.422747 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7b59a185-47f7-4d83-9b3b-bbc5871488ab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:44.429893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7b59a185-47f7-4d83-9b3b-bbc5871488ab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:44.430351 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7b59a185-47f7-4d83-9b3b-bbc5871488ab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:44.431124 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7b59a185-47f7-4d83-9b3b-bbc5871488ab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:44.431572 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7b59a185-47f7-4d83-9b3b-bbc5871488ab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:44.436231 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:44.567257 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7b59a185-47f7-4d83-9b3b-bbc5871488ab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:44.575138 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7b59a185-47f7-4d83-9b3b-bbc5871488ab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:44.576822 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7b59a185-47f7-4d83-9b3b-bbc5871488ab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:44.578000 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7b59a185-47f7-4d83-9b3b-bbc5871488ab tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.159986 Jul 04 09:24:44.578557 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 373/750] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:44 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:45.596818 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d737072a-48a1-4ddb-8648-79b3922c6449 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:45.597393 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d737072a-48a1-4ddb-8648-79b3922c6449 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:45.603900 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d737072a-48a1-4ddb-8648-79b3922c6449 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:45.604378 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d737072a-48a1-4ddb-8648-79b3922c6449 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:45.605191 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d737072a-48a1-4ddb-8648-79b3922c6449 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:45.605635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d737072a-48a1-4ddb-8648-79b3922c6449 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:45.733259 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d737072a-48a1-4ddb-8648-79b3922c6449 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:45.741147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d737072a-48a1-4ddb-8648-79b3922c6449 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:45.742663 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d737072a-48a1-4ddb-8648-79b3922c6449 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:45.743812 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d737072a-48a1-4ddb-8648-79b3922c6449 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.151004 Jul 04 09:24:45.744375 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 378/751] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:45 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:46.762663 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ffc19d44-f9af-4152-b05f-b83e6ae81767 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:46.764028 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ffc19d44-f9af-4152-b05f-b83e6ae81767 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:46.770339 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffc19d44-f9af-4152-b05f-b83e6ae81767 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:46.770803 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffc19d44-f9af-4152-b05f-b83e6ae81767 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:46.771570 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffc19d44-f9af-4152-b05f-b83e6ae81767 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:46.772021 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffc19d44-f9af-4152-b05f-b83e6ae81767 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:46.920870 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ffc19d44-f9af-4152-b05f-b83e6ae81767 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:46.926602 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ffc19d44-f9af-4152-b05f-b83e6ae81767 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:46.928100 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ffc19d44-f9af-4152-b05f-b83e6ae81767 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:46.929368 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ffc19d44-f9af-4152-b05f-b83e6ae81767 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.170519 Jul 04 09:24:46.929935 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 374/752] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:46 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:47.947759 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-090134a7-3662-44e9-969a-af333ad064b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:47.948377 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-090134a7-3662-44e9-969a-af333ad064b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:47.955712 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-090134a7-3662-44e9-969a-af333ad064b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:47.956170 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-090134a7-3662-44e9-969a-af333ad064b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:47.956940 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-090134a7-3662-44e9-969a-af333ad064b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:47.957417 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-090134a7-3662-44e9-969a-af333ad064b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:48.082381 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-090134a7-3662-44e9-969a-af333ad064b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:48.090282 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-090134a7-3662-44e9-969a-af333ad064b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:48.092272 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-090134a7-3662-44e9-969a-af333ad064b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:48.093456 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-090134a7-3662-44e9-969a-af333ad064b4 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1747 microversion: 2.20 time: 0.149595 Jul 04 09:24:48.094018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 379/753] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:47 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:49.112414 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d92eaefb-6d5a-4e11-822b-c5394ad5a5e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:49.112963 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d92eaefb-6d5a-4e11-822b-c5394ad5a5e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:49.119602 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d92eaefb-6d5a-4e11-822b-c5394ad5a5e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:49.120062 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d92eaefb-6d5a-4e11-822b-c5394ad5a5e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:49.120833 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d92eaefb-6d5a-4e11-822b-c5394ad5a5e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:49.121321 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d92eaefb-6d5a-4e11-822b-c5394ad5a5e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:49.253920 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d92eaefb-6d5a-4e11-822b-c5394ad5a5e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:49.261884 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d92eaefb-6d5a-4e11-822b-c5394ad5a5e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:49.263407 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d92eaefb-6d5a-4e11-822b-c5394ad5a5e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:49.264566 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d92eaefb-6d5a-4e11-822b-c5394ad5a5e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1747 microversion: 2.20 time: 0.156145 Jul 04 09:24:49.265142 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 375/754] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:49 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:50.228942 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d251a8cd-3d79-4b97-97f0-6d3863de009d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:50.229888 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d251a8cd-3d79-4b97-97f0-6d3863de009d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:50.238608 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d251a8cd-3d79-4b97-97f0-6d3863de009d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.239104 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d251a8cd-3d79-4b97-97f0-6d3863de009d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.240127 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d251a8cd-3d79-4b97-97f0-6d3863de009d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.240573 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d251a8cd-3d79-4b97-97f0-6d3863de009d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.283452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2afe29b3-f0f4-4a41-a815-0098af9b1ae1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:50.284099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2afe29b3-f0f4-4a41-a815-0098af9b1ae1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:50.292045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2afe29b3-f0f4-4a41-a815-0098af9b1ae1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.292503 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2afe29b3-f0f4-4a41-a815-0098af9b1ae1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.293335 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2afe29b3-f0f4-4a41-a815-0098af9b1ae1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.293779 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2afe29b3-f0f4-4a41-a815-0098af9b1ae1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.324578 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d251a8cd-3d79-4b97-97f0-6d3863de009d tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "POST /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/action" status: 202 len: 0 microversion: 2.1 time: 0.099441 Jul 04 09:24:50.325479 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 380/755] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:24:50 2022] POST /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:24:50.335201 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-05693ead-d953-4c1f-a230-d6dfb5455d71 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:50.335903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-05693ead-d953-4c1f-a230-d6dfb5455d71 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:50.344126 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05693ead-d953-4c1f-a230-d6dfb5455d71 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.344854 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05693ead-d953-4c1f-a230-d6dfb5455d71 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.345674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05693ead-d953-4c1f-a230-d6dfb5455d71 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:50.346158 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-05693ead-d953-4c1f-a230-d6dfb5455d71 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:50.552465 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2afe29b3-f0f4-4a41-a815-0098af9b1ae1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:50.561161 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2afe29b3-f0f4-4a41-a815-0098af9b1ae1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:50.562789 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2afe29b3-f0f4-4a41-a815-0098af9b1ae1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:50.563977 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2afe29b3-f0f4-4a41-a815-0098af9b1ae1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1742 microversion: 2.20 time: 0.284657 Jul 04 09:24:50.564535 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 376/756] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:50 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1742 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:24:50.592384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-05693ead-d953-4c1f-a230-d6dfb5455d71 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:50.601350 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-05693ead-d953-4c1f-a230-d6dfb5455d71 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1749 microversion: 2.1 time: 0.270860 Jul 04 09:24:50.601927 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 381/757] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:50 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1749 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:51.582538 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5a421e08-5233-413e-a771-cfa5017dabbd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:51.583251 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5a421e08-5233-413e-a771-cfa5017dabbd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:51.590075 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5a421e08-5233-413e-a771-cfa5017dabbd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:51.591326 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5a421e08-5233-413e-a771-cfa5017dabbd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:51.592829 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5a421e08-5233-413e-a771-cfa5017dabbd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:51.593370 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5a421e08-5233-413e-a771-cfa5017dabbd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:51.619416 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d124ea32-1982-425d-9ef6-9d7ff1a36ef0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:51.620687 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d124ea32-1982-425d-9ef6-9d7ff1a36ef0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:51.628674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d124ea32-1982-425d-9ef6-9d7ff1a36ef0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:51.629423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d124ea32-1982-425d-9ef6-9d7ff1a36ef0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:51.630370 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d124ea32-1982-425d-9ef6-9d7ff1a36ef0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:51.631112 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d124ea32-1982-425d-9ef6-9d7ff1a36ef0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:51.789351 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5a421e08-5233-413e-a771-cfa5017dabbd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:51.802393 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5a421e08-5233-413e-a771-cfa5017dabbd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:51.804552 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5a421e08-5233-413e-a771-cfa5017dabbd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:51.806375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5a421e08-5233-413e-a771-cfa5017dabbd tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1742 microversion: 2.20 time: 0.227961 Jul 04 09:24:51.807124 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 377/758] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:51 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1742 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:24:51.829967 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d124ea32-1982-425d-9ef6-9d7ff1a36ef0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:51.845633 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d124ea32-1982-425d-9ef6-9d7ff1a36ef0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.230145 Jul 04 09:24:51.846227 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 382/759] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:51 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:52.825247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-68d9bf22-2c28-47f2-abd3-d787a207a5db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:52.826043 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-68d9bf22-2c28-47f2-abd3-d787a207a5db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:52.828487 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:52.835741 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-68d9bf22-2c28-47f2-abd3-d787a207a5db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:52.836203 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-68d9bf22-2c28-47f2-abd3-d787a207a5db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:52.836991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-68d9bf22-2c28-47f2-abd3-d787a207a5db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:52.837467 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-68d9bf22-2c28-47f2-abd3-d787a207a5db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:52.863551 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1ae25f34-32fe-4014-95a4-a86867cafd39 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:52.866527 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1ae25f34-32fe-4014-95a4-a86867cafd39 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:52.867555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:24:52.878316 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ae25f34-32fe-4014-95a4-a86867cafd39 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:52.878950 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ae25f34-32fe-4014-95a4-a86867cafd39 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:52.880174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ae25f34-32fe-4014-95a4-a86867cafd39 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:52.880694 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1ae25f34-32fe-4014-95a4-a86867cafd39 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:53.063142 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-68d9bf22-2c28-47f2-abd3-d787a207a5db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:53.077065 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-68d9bf22-2c28-47f2-abd3-d787a207a5db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:53.079026 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-68d9bf22-2c28-47f2-abd3-d787a207a5db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:53.080429 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-68d9bf22-2c28-47f2-abd3-d787a207a5db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1742 microversion: 2.20 time: 0.259278 Jul 04 09:24:53.092900 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 378/760] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:52 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1742 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:53.138476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1ae25f34-32fe-4014-95a4-a86867cafd39 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:53.149133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1ae25f34-32fe-4014-95a4-a86867cafd39 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.290153 Jul 04 09:24:53.159928 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 383/761] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:52 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:53.299465 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-8037507a-696f-4b97-a007-e665152eaa3c req-72cdf1d3-1961-4db6-92c9-f6890a10ef6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1af165-f9ff-409d-a80d-0998b4f545d9", "name": "network-vif-plugged", "status": "completed", "tag": "a2d58751-fbe0-49d6-b04c-2629ea26d8f4"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:24:53.308856 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-8037507a-696f-4b97-a007-e665152eaa3c req-72cdf1d3-1961-4db6-92c9-f6890a10ef6c service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:53.309491 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-8037507a-696f-4b97-a007-e665152eaa3c req-72cdf1d3-1961-4db6-92c9-f6890a10ef6c service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:53.326103 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-8037507a-696f-4b97-a007-e665152eaa3c req-72cdf1d3-1961-4db6-92c9-f6890a10ef6c service nova] Creating event network-vif-plugged:a2d58751-fbe0-49d6-b04c-2629ea26d8f4 for instance fc1af165-f9ff-409d-a80d-0998b4f545d9 on hv-cinder-84456 Jul 04 09:24:53.331322 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-8037507a-696f-4b97-a007-e665152eaa3c req-72cdf1d3-1961-4db6-92c9-f6890a10ef6c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124711 Jul 04 09:24:53.332145 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 379/762] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:24:54.100092 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-744f81b0-b9d3-48f1-8dc5-0bd2a17092b5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:54.101342 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-744f81b0-b9d3-48f1-8dc5-0bd2a17092b5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:54.108703 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-744f81b0-b9d3-48f1-8dc5-0bd2a17092b5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:54.109478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-744f81b0-b9d3-48f1-8dc5-0bd2a17092b5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:54.110502 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-744f81b0-b9d3-48f1-8dc5-0bd2a17092b5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:54.111311 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-744f81b0-b9d3-48f1-8dc5-0bd2a17092b5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:54.167328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-12485f95-aba8-4939-94dd-1eba724cef91 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:54.170353 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-12485f95-aba8-4939-94dd-1eba724cef91 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:54.178424 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12485f95-aba8-4939-94dd-1eba724cef91 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:54.178986 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12485f95-aba8-4939-94dd-1eba724cef91 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:54.180340 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12485f95-aba8-4939-94dd-1eba724cef91 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:54.180340 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12485f95-aba8-4939-94dd-1eba724cef91 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:54.292550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-744f81b0-b9d3-48f1-8dc5-0bd2a17092b5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:54.304153 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-744f81b0-b9d3-48f1-8dc5-0bd2a17092b5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:54.305827 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-744f81b0-b9d3-48f1-8dc5-0bd2a17092b5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:54.307139 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-744f81b0-b9d3-48f1-8dc5-0bd2a17092b5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1742 microversion: 2.20 time: 0.212168 Jul 04 09:24:54.319875 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 384/763] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:54 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1742 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:54.377218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-12485f95-aba8-4939-94dd-1eba724cef91 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:54.399755 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-12485f95-aba8-4939-94dd-1eba724cef91 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.236538 Jul 04 09:24:54.400677 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 380/764] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:54 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:55.327416 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b46cc333-74f6-42d0-9bf5-440b7d446338 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:55.328589 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b46cc333-74f6-42d0-9bf5-440b7d446338 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:55.336017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b46cc333-74f6-42d0-9bf5-440b7d446338 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:55.336476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b46cc333-74f6-42d0-9bf5-440b7d446338 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:55.337288 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b46cc333-74f6-42d0-9bf5-440b7d446338 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:55.337733 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b46cc333-74f6-42d0-9bf5-440b7d446338 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:55.425949 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3c8acbcf-a57e-42b4-afe5-a96881b861b6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:55.427035 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3c8acbcf-a57e-42b4-afe5-a96881b861b6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:55.434044 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c8acbcf-a57e-42b4-afe5-a96881b861b6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:55.435299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c8acbcf-a57e-42b4-afe5-a96881b861b6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:55.436103 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c8acbcf-a57e-42b4-afe5-a96881b861b6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:55.436800 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c8acbcf-a57e-42b4-afe5-a96881b861b6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:55.531227 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b46cc333-74f6-42d0-9bf5-440b7d446338 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:55.540303 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b46cc333-74f6-42d0-9bf5-440b7d446338 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:55.542118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b46cc333-74f6-42d0-9bf5-440b7d446338 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:55.543355 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b46cc333-74f6-42d0-9bf5-440b7d446338 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1742 microversion: 2.20 time: 0.221201 Jul 04 09:24:55.553078 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 385/765] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:55 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1742 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:55.621797 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3c8acbcf-a57e-42b4-afe5-a96881b861b6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:55.633052 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3c8acbcf-a57e-42b4-afe5-a96881b861b6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.215027 Jul 04 09:24:55.633652 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 381/766] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:55 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:56.561528 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0e2695cb-1dc1-49b9-a3a0-03da395d27d7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:56.562182 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0e2695cb-1dc1-49b9-a3a0-03da395d27d7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:56.568833 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e2695cb-1dc1-49b9-a3a0-03da395d27d7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:56.569324 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e2695cb-1dc1-49b9-a3a0-03da395d27d7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:56.570109 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e2695cb-1dc1-49b9-a3a0-03da395d27d7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:56.570696 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0e2695cb-1dc1-49b9-a3a0-03da395d27d7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:56.669960 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b2781367-5f0b-4d1d-bcf3-91a0bd8b52fb tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:56.670588 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b2781367-5f0b-4d1d-bcf3-91a0bd8b52fb tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:56.679067 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2781367-5f0b-4d1d-bcf3-91a0bd8b52fb tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:56.679521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2781367-5f0b-4d1d-bcf3-91a0bd8b52fb tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:56.680301 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2781367-5f0b-4d1d-bcf3-91a0bd8b52fb tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:56.680743 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b2781367-5f0b-4d1d-bcf3-91a0bd8b52fb tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:56.777782 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0e2695cb-1dc1-49b9-a3a0-03da395d27d7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:56.790052 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0e2695cb-1dc1-49b9-a3a0-03da395d27d7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:56.791978 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0e2695cb-1dc1-49b9-a3a0-03da395d27d7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:56.796675 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0e2695cb-1dc1-49b9-a3a0-03da395d27d7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1742 microversion: 2.20 time: 0.239031 Jul 04 09:24:56.797834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 386/767] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:56 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1742 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:56.875855 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b2781367-5f0b-4d1d-bcf3-91a0bd8b52fb tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:56.885010 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b2781367-5f0b-4d1d-bcf3-91a0bd8b52fb tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.223095 Jul 04 09:24:56.895535 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 382/768] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:56 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:24:57.817446 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff2a7fd4-bbfd-482e-906c-d049abf2468c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:57.818066 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff2a7fd4-bbfd-482e-906c-d049abf2468c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:57.825660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff2a7fd4-bbfd-482e-906c-d049abf2468c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:57.826468 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff2a7fd4-bbfd-482e-906c-d049abf2468c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:57.827617 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff2a7fd4-bbfd-482e-906c-d049abf2468c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:57.828269 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff2a7fd4-bbfd-482e-906c-d049abf2468c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:57.905910 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a7a11ece-6917-463a-8530-99e8bc38b5a6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:57.907159 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a7a11ece-6917-463a-8530-99e8bc38b5a6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:57.915370 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7a11ece-6917-463a-8530-99e8bc38b5a6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:57.918554 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7a11ece-6917-463a-8530-99e8bc38b5a6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:57.920110 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7a11ece-6917-463a-8530-99e8bc38b5a6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:57.921141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a7a11ece-6917-463a-8530-99e8bc38b5a6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:57.972628 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff2a7fd4-bbfd-482e-906c-d049abf2468c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:57.981083 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff2a7fd4-bbfd-482e-906c-d049abf2468c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:57.984710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff2a7fd4-bbfd-482e-906c-d049abf2468c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:57.987638 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff2a7fd4-bbfd-482e-906c-d049abf2468c tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1742 microversion: 2.20 time: 0.173127 Jul 04 09:24:57.988420 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 387/769] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:57 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:58.098540 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a7a11ece-6917-463a-8530-99e8bc38b5a6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:58.107327 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a7a11ece-6917-463a-8530-99e8bc38b5a6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.205603 Jul 04 09:24:58.108260 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 383/770] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:57 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:24:59.006965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1a863590-db87-433f-9c61-b5a9522bb7d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:59.007616 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1a863590-db87-433f-9c61-b5a9522bb7d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:59.015517 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a863590-db87-433f-9c61-b5a9522bb7d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:59.015969 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a863590-db87-433f-9c61-b5a9522bb7d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:59.016760 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a863590-db87-433f-9c61-b5a9522bb7d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:59.017243 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a863590-db87-433f-9c61-b5a9522bb7d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:59.124965 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-929f9348-670d-40e9-9241-ee32f42e3237 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:24:59.125794 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-929f9348-670d-40e9-9241-ee32f42e3237 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:24:59.132603 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-929f9348-670d-40e9-9241-ee32f42e3237 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:59.133296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-929f9348-670d-40e9-9241-ee32f42e3237 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:59.134442 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-929f9348-670d-40e9-9241-ee32f42e3237 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:24:59.134981 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-929f9348-670d-40e9-9241-ee32f42e3237 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:24:59.155629 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1a863590-db87-433f-9c61-b5a9522bb7d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:59.168014 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1a863590-db87-433f-9c61-b5a9522bb7d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:59.170348 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1a863590-db87-433f-9c61-b5a9522bb7d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:59.171607 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1a863590-db87-433f-9c61-b5a9522bb7d8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1742 microversion: 2.20 time: 0.168714 Jul 04 09:24:59.172230 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 388/771] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:24:59 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:24:59.288721 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-929f9348-670d-40e9-9241-ee32f42e3237 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:24:59.297610 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-929f9348-670d-40e9-9241-ee32f42e3237 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.177309 Jul 04 09:24:59.298173 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 384/772] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:24:59 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:00.190669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-65c3df52-a95f-44fd-87fe-726e9ce1b00b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:00.191389 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-65c3df52-a95f-44fd-87fe-726e9ce1b00b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:00.197890 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65c3df52-a95f-44fd-87fe-726e9ce1b00b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:00.198351 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65c3df52-a95f-44fd-87fe-726e9ce1b00b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:00.199132 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65c3df52-a95f-44fd-87fe-726e9ce1b00b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:00.199576 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-65c3df52-a95f-44fd-87fe-726e9ce1b00b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:00.315426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-59a34c33-5911-43aa-b446-8daf2a1e2cfa tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:00.316052 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-59a34c33-5911-43aa-b446-8daf2a1e2cfa tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:00.323307 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59a34c33-5911-43aa-b446-8daf2a1e2cfa tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:00.323697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59a34c33-5911-43aa-b446-8daf2a1e2cfa tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:00.324479 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59a34c33-5911-43aa-b446-8daf2a1e2cfa tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:00.324925 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-59a34c33-5911-43aa-b446-8daf2a1e2cfa tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:00.329647 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-65c3df52-a95f-44fd-87fe-726e9ce1b00b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:00.337897 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-65c3df52-a95f-44fd-87fe-726e9ce1b00b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:00.339453 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-65c3df52-a95f-44fd-87fe-726e9ce1b00b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:00.340653 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-65c3df52-a95f-44fd-87fe-726e9ce1b00b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1724 microversion: 2.20 time: 0.154348 Jul 04 09:25:00.341186 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 389/773] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:00 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:00.468308 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-59a34c33-5911-43aa-b446-8daf2a1e2cfa tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:00.476512 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-59a34c33-5911-43aa-b446-8daf2a1e2cfa tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.165051 Jul 04 09:25:00.477097 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 385/774] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:00 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:01.359792 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bd8eb57b-0ef0-454b-bcdc-9ed1b7213af3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:01.360409 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bd8eb57b-0ef0-454b-bcdc-9ed1b7213af3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:01.367009 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd8eb57b-0ef0-454b-bcdc-9ed1b7213af3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:01.367470 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd8eb57b-0ef0-454b-bcdc-9ed1b7213af3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:01.368243 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd8eb57b-0ef0-454b-bcdc-9ed1b7213af3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:01.368680 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bd8eb57b-0ef0-454b-bcdc-9ed1b7213af3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:01.494373 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-75c5abd0-f366-4223-ab3a-7ad843632899 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:01.495003 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-75c5abd0-f366-4223-ab3a-7ad843632899 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:01.502381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75c5abd0-f366-4223-ab3a-7ad843632899 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:01.502844 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75c5abd0-f366-4223-ab3a-7ad843632899 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:01.503628 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75c5abd0-f366-4223-ab3a-7ad843632899 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:01.503922 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bd8eb57b-0ef0-454b-bcdc-9ed1b7213af3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:01.504075 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75c5abd0-f366-4223-ab3a-7ad843632899 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:01.511931 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bd8eb57b-0ef0-454b-bcdc-9ed1b7213af3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:01.513719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bd8eb57b-0ef0-454b-bcdc-9ed1b7213af3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:01.514877 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bd8eb57b-0ef0-454b-bcdc-9ed1b7213af3 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1724 microversion: 2.20 time: 0.159699 Jul 04 09:25:01.515644 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 390/775] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:01 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:01.645983 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-75c5abd0-f366-4223-ab3a-7ad843632899 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:01.653997 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-75c5abd0-f366-4223-ab3a-7ad843632899 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.163527 Jul 04 09:25:01.654573 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 386/776] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:01 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:02.533627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ff6209ae-67f7-4588-9ed4-b84f6777c8e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:02.534259 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ff6209ae-67f7-4588-9ed4-b84f6777c8e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:02.540300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff6209ae-67f7-4588-9ed4-b84f6777c8e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:02.540782 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff6209ae-67f7-4588-9ed4-b84f6777c8e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:02.541576 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff6209ae-67f7-4588-9ed4-b84f6777c8e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:02.542017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ff6209ae-67f7-4588-9ed4-b84f6777c8e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:02.556606 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:02.670875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e5188222-7799-4249-9d6b-8dce15aaac17 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:02.671582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e5188222-7799-4249-9d6b-8dce15aaac17 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:02.678247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5188222-7799-4249-9d6b-8dce15aaac17 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:02.678466 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff6209ae-67f7-4588-9ed4-b84f6777c8e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:02.678697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5188222-7799-4249-9d6b-8dce15aaac17 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:02.679541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5188222-7799-4249-9d6b-8dce15aaac17 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:02.680029 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e5188222-7799-4249-9d6b-8dce15aaac17 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:02.688606 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff6209ae-67f7-4588-9ed4-b84f6777c8e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:02.690176 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ff6209ae-67f7-4588-9ed4-b84f6777c8e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:02.691372 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ff6209ae-67f7-4588-9ed4-b84f6777c8e8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1727 microversion: 2.20 time: 0.161790 Jul 04 09:25:02.691933 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 391/777] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:02 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:02.715333 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-adfb139d-8caf-4a01-ae96-a371a82e8876 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7b705b7-477b-4144-b4f7-6bd34a079fa3"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:02.716570 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-adfb139d-8caf-4a01-ae96-a371a82e8876 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:02.723195 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-adfb139d-8caf-4a01-ae96-a371a82e8876 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:02.723645 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-adfb139d-8caf-4a01-ae96-a371a82e8876 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:02.724415 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-adfb139d-8caf-4a01-ae96-a371a82e8876 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:02.724857 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-adfb139d-8caf-4a01-ae96-a371a82e8876 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:02.837828 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e5188222-7799-4249-9d6b-8dce15aaac17 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:02.850889 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e5188222-7799-4249-9d6b-8dce15aaac17 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.184031 Jul 04 09:25:02.853514 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 387/778] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:02 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:03.056244 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-adfb139d-8caf-4a01-ae96-a371a82e8876 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "POST /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.345409 Jul 04 09:25:03.056863 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 392/779] 10.222.0.71 () {62 vars in 1363 bytes} [Mon Jul 4 09:25:02 2022] POST /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/os-volume_attachments => generated 188 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 09:25:03.183216 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f2bb90ab-87e1-4943-a16c-8858c04bffb8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:03.183711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f2bb90ab-87e1-4943-a16c-8858c04bffb8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:03.190038 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-8a5db892-b312-411d-8be1-faf0356d6772 req-1dbfc178-6e6d-40ee-b608-7fbf54bd3ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1af165-f9ff-409d-a80d-0998b4f545d9", "name": "network-vif-unplugged", "status": "completed", "tag": "a2d58751-fbe0-49d6-b04c-2629ea26d8f4"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:03.190449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f2bb90ab-87e1-4943-a16c-8858c04bffb8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:03.190825 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f2bb90ab-87e1-4943-a16c-8858c04bffb8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:03.191908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f2bb90ab-87e1-4943-a16c-8858c04bffb8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:03.192275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f2bb90ab-87e1-4943-a16c-8858c04bffb8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:03.208607 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8a5db892-b312-411d-8be1-faf0356d6772 req-1dbfc178-6e6d-40ee-b608-7fbf54bd3ce0 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:03.209075 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8a5db892-b312-411d-8be1-faf0356d6772 req-1dbfc178-6e6d-40ee-b608-7fbf54bd3ce0 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:03.223275 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.compute.server_external_events [req-8a5db892-b312-411d-8be1-faf0356d6772 req-1dbfc178-6e6d-40ee-b608-7fbf54bd3ce0 service nova] Unable to find a host for instance fc1af165-f9ff-409d-a80d-0998b4f545d9. Dropping event network-vif-unplugged {{(pid=117664) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 04 09:25:03.224330 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-8a5db892-b312-411d-8be1-faf0356d6772 req-1dbfc178-6e6d-40ee-b608-7fbf54bd3ce0 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040828 Jul 04 09:25:03.225306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 393/780] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 04 09:25:03.440563 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:03.465429 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f2bb90ab-87e1-4943-a16c-8858c04bffb8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "DELETE /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/os-volume_attachments/a7b705b7-477b-4144-b4f7-6bd34a079fa3" status: 202 len: 0 microversion: 2.20 time: 0.283008 Jul 04 09:25:03.467126 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 388/781] 10.222.0.71 () {60 vars in 1456 bytes} [Mon Jul 4 09:25:03 2022] DELETE /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/os-volume_attachments/a7b705b7-477b-4144-b4f7-6bd34a079fa3 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:25:03.529792 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bfac5e44-dbf9-4a7b-84f2-eff01058d0c5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:03.530356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bfac5e44-dbf9-4a7b-84f2-eff01058d0c5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:03.536893 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bfac5e44-dbf9-4a7b-84f2-eff01058d0c5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:03.538020 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bfac5e44-dbf9-4a7b-84f2-eff01058d0c5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:03.538193 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bfac5e44-dbf9-4a7b-84f2-eff01058d0c5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:03.538630 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bfac5e44-dbf9-4a7b-84f2-eff01058d0c5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:03.627131 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bfac5e44-dbf9-4a7b-84f2-eff01058d0c5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "POST /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/action" status: 202 len: 0 microversion: 2.20 time: 0.101855 Jul 04 09:25:03.627960 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 394/782] 10.222.0.71 () {62 vars in 1318 bytes} [Mon Jul 4 09:25:03 2022] POST /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:25:03.637347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-24e75594-d55c-4252-8241-f5972f20fd4b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:03.638753 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-24e75594-d55c-4252-8241-f5972f20fd4b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:03.645019 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-24e75594-d55c-4252-8241-f5972f20fd4b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:03.645515 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-24e75594-d55c-4252-8241-f5972f20fd4b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:03.646301 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-24e75594-d55c-4252-8241-f5972f20fd4b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:03.646749 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-24e75594-d55c-4252-8241-f5972f20fd4b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:03.790056 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-24e75594-d55c-4252-8241-f5972f20fd4b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:03.802337 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-24e75594-d55c-4252-8241-f5972f20fd4b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:03.803911 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-24e75594-d55c-4252-8241-f5972f20fd4b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:03.805138 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-24e75594-d55c-4252-8241-f5972f20fd4b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1675 microversion: 2.20 time: 0.172644 Jul 04 09:25:03.805689 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 389/783] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:03 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:03.871122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d354059f-019b-48da-9b5a-bb98aa4d6ea5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:03.871963 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d354059f-019b-48da-9b5a-bb98aa4d6ea5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:03.879125 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d354059f-019b-48da-9b5a-bb98aa4d6ea5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:03.879581 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d354059f-019b-48da-9b5a-bb98aa4d6ea5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:03.881110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d354059f-019b-48da-9b5a-bb98aa4d6ea5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:03.881577 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d354059f-019b-48da-9b5a-bb98aa4d6ea5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:04.051897 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d354059f-019b-48da-9b5a-bb98aa4d6ea5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:04.060615 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d354059f-019b-48da-9b5a-bb98aa4d6ea5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.194043 Jul 04 09:25:04.061238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 395/784] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:03 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:04.825976 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e6a43fa0-c6ec-4003-a2d6-fb10b1e0d099 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:04.826591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e6a43fa0-c6ec-4003-a2d6-fb10b1e0d099 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:04.833132 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e6a43fa0-c6ec-4003-a2d6-fb10b1e0d099 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:04.833590 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e6a43fa0-c6ec-4003-a2d6-fb10b1e0d099 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:04.834355 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e6a43fa0-c6ec-4003-a2d6-fb10b1e0d099 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:04.834798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e6a43fa0-c6ec-4003-a2d6-fb10b1e0d099 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:04.966192 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e6a43fa0-c6ec-4003-a2d6-fb10b1e0d099 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:04.974344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e6a43fa0-c6ec-4003-a2d6-fb10b1e0d099 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:04.975839 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e6a43fa0-c6ec-4003-a2d6-fb10b1e0d099 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:04.977100 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e6a43fa0-c6ec-4003-a2d6-fb10b1e0d099 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.155747 Jul 04 09:25:04.977997 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 390/785] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:04 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:05.078768 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8ed4e1b5-71bd-474a-950b-5323cc098428 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:05.079432 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8ed4e1b5-71bd-474a-950b-5323cc098428 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:05.085971 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8ed4e1b5-71bd-474a-950b-5323cc098428 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:05.086430 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8ed4e1b5-71bd-474a-950b-5323cc098428 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:05.087195 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8ed4e1b5-71bd-474a-950b-5323cc098428 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:05.087637 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8ed4e1b5-71bd-474a-950b-5323cc098428 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:05.233799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8ed4e1b5-71bd-474a-950b-5323cc098428 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:05.241804 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8ed4e1b5-71bd-474a-950b-5323cc098428 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.167968 Jul 04 09:25:05.242374 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 396/786] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:05 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:05.646146 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-bc737221-1cb0-4c69-aa5c-2993379584b1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:05.646661 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-bc737221-1cb0-4c69-aa5c-2993379584b1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:05.652846 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bc737221-1cb0-4c69-aa5c-2993379584b1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:05.653843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bc737221-1cb0-4c69-aa5c-2993379584b1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:05.654935 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bc737221-1cb0-4c69-aa5c-2993379584b1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:05.655379 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-bc737221-1cb0-4c69-aa5c-2993379584b1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:05.679937 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-bc737221-1cb0-4c69-aa5c-2993379584b1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/ips" status: 200 len: 146 microversion: 2.1 time: 0.091819 Jul 04 09:25:05.680497 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 391/787] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 4 09:25:05 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/ips => generated 146 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:25:06.002675 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5d44e642-be0b-4cc6-9c1f-88944579cab0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:06.007460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5d44e642-be0b-4cc6-9c1f-88944579cab0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:06.018234 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d44e642-be0b-4cc6-9c1f-88944579cab0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:06.021708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d44e642-be0b-4cc6-9c1f-88944579cab0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:06.022611 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d44e642-be0b-4cc6-9c1f-88944579cab0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:06.023918 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5d44e642-be0b-4cc6-9c1f-88944579cab0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:06.199192 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d44e642-be0b-4cc6-9c1f-88944579cab0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:06.210116 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d44e642-be0b-4cc6-9c1f-88944579cab0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:06.211609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-5d44e642-be0b-4cc6-9c1f-88944579cab0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:06.212830 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5d44e642-be0b-4cc6-9c1f-88944579cab0 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.219725 Jul 04 09:25:06.213432 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 397/788] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:05 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:25:06.267209 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5df82df1-ad99-4cd2-ab19-ccf0f82d84b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:06.268878 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5df82df1-ad99-4cd2-ab19-ccf0f82d84b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:06.279715 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5df82df1-ad99-4cd2-ab19-ccf0f82d84b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:06.280638 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5df82df1-ad99-4cd2-ab19-ccf0f82d84b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:06.281910 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5df82df1-ad99-4cd2-ab19-ccf0f82d84b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:06.282737 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5df82df1-ad99-4cd2-ab19-ccf0f82d84b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:06.453644 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5df82df1-ad99-4cd2-ab19-ccf0f82d84b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:06.464385 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5df82df1-ad99-4cd2-ab19-ccf0f82d84b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.203795 Jul 04 09:25:06.465747 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 392/789] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:06 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:07.029402 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f29f6d2c-03c9-4203-b98f-0ea2072a11e7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a8c5ba3-ef70-4b97-a458-26df152adaec"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:07.030522 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f29f6d2c-03c9-4203-b98f-0ea2072a11e7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:07.041096 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f29f6d2c-03c9-4203-b98f-0ea2072a11e7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:07.041562 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f29f6d2c-03c9-4203-b98f-0ea2072a11e7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:07.042349 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f29f6d2c-03c9-4203-b98f-0ea2072a11e7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:07.042794 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f29f6d2c-03c9-4203-b98f-0ea2072a11e7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:07.231911 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a99c3d51-3180-43df-9322-86733ea9a48b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:07.232439 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a99c3d51-3180-43df-9322-86733ea9a48b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:07.238756 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a99c3d51-3180-43df-9322-86733ea9a48b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:07.239214 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a99c3d51-3180-43df-9322-86733ea9a48b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:07.239985 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a99c3d51-3180-43df-9322-86733ea9a48b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:07.240431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a99c3d51-3180-43df-9322-86733ea9a48b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:07.379943 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a99c3d51-3180-43df-9322-86733ea9a48b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:07.389495 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a99c3d51-3180-43df-9322-86733ea9a48b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:07.391034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a99c3d51-3180-43df-9322-86733ea9a48b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:07.392648 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a99c3d51-3180-43df-9322-86733ea9a48b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.164830 Jul 04 09:25:07.393604 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 393/790] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:07 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:25:07.486002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6843c3bf-0c81-4142-9be6-f476e84debe3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:07.486593 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6843c3bf-0c81-4142-9be6-f476e84debe3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:07.493084 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6843c3bf-0c81-4142-9be6-f476e84debe3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:07.493541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6843c3bf-0c81-4142-9be6-f476e84debe3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:07.494313 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6843c3bf-0c81-4142-9be6-f476e84debe3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:07.494747 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6843c3bf-0c81-4142-9be6-f476e84debe3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:07.650888 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6843c3bf-0c81-4142-9be6-f476e84debe3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:07.659856 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6843c3bf-0c81-4142-9be6-f476e84debe3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.179657 Jul 04 09:25:07.660546 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 394/791] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:07 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:08.412457 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1ee8aa62-9ccb-4285-9e33-dab54e9341cb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:08.413244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1ee8aa62-9ccb-4285-9e33-dab54e9341cb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:08.423012 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ee8aa62-9ccb-4285-9e33-dab54e9341cb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:08.423474 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ee8aa62-9ccb-4285-9e33-dab54e9341cb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:08.424289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ee8aa62-9ccb-4285-9e33-dab54e9341cb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:08.424729 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1ee8aa62-9ccb-4285-9e33-dab54e9341cb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:08.586148 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1ee8aa62-9ccb-4285-9e33-dab54e9341cb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:08.596930 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1ee8aa62-9ccb-4285-9e33-dab54e9341cb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:08.598497 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1ee8aa62-9ccb-4285-9e33-dab54e9341cb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:08.599697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1ee8aa62-9ccb-4285-9e33-dab54e9341cb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.191543 Jul 04 09:25:08.610774 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 395/792] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:08 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:25:08.676926 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ec7763b5-8202-4241-a552-8570dfde4dfe tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:08.677591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ec7763b5-8202-4241-a552-8570dfde4dfe tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:08.684454 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ec7763b5-8202-4241-a552-8570dfde4dfe tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:08.685025 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ec7763b5-8202-4241-a552-8570dfde4dfe tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:08.686166 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ec7763b5-8202-4241-a552-8570dfde4dfe tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:08.686719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ec7763b5-8202-4241-a552-8570dfde4dfe tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:08.844455 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ec7763b5-8202-4241-a552-8570dfde4dfe tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:08.852950 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ec7763b5-8202-4241-a552-8570dfde4dfe tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.179909 Jul 04 09:25:08.853558 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 396/793] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:08 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:09.619609 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f8be5795-f6d1-453d-9188-95afd0d1103a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:09.620374 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f8be5795-f6d1-453d-9188-95afd0d1103a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:09.628339 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f8be5795-f6d1-453d-9188-95afd0d1103a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:09.628996 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f8be5795-f6d1-453d-9188-95afd0d1103a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:09.629806 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f8be5795-f6d1-453d-9188-95afd0d1103a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:09.633924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f8be5795-f6d1-453d-9188-95afd0d1103a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:09.777100 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f8be5795-f6d1-453d-9188-95afd0d1103a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:09.785796 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f8be5795-f6d1-453d-9188-95afd0d1103a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:09.787372 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f8be5795-f6d1-453d-9188-95afd0d1103a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:09.788508 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f8be5795-f6d1-453d-9188-95afd0d1103a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.173900 Jul 04 09:25:09.789595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 397/794] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:09 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:25:09.871041 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0f52d72a-bde1-44f9-97a5-b8db5ac7e8c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:09.871643 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0f52d72a-bde1-44f9-97a5-b8db5ac7e8c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:09.877980 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0f52d72a-bde1-44f9-97a5-b8db5ac7e8c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:09.878436 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0f52d72a-bde1-44f9-97a5-b8db5ac7e8c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:09.879213 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0f52d72a-bde1-44f9-97a5-b8db5ac7e8c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:09.879656 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0f52d72a-bde1-44f9-97a5-b8db5ac7e8c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:10.033147 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0f52d72a-bde1-44f9-97a5-b8db5ac7e8c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:10.041408 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0f52d72a-bde1-44f9-97a5-b8db5ac7e8c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.174469 Jul 04 09:25:10.041990 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 398/795] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:09 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:10.809093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-48797980-9d34-437f-b735-3c9c8265ad85 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:10.809093 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-48797980-9d34-437f-b735-3c9c8265ad85 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:10.817961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48797980-9d34-437f-b735-3c9c8265ad85 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:10.818412 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48797980-9d34-437f-b735-3c9c8265ad85 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:10.819186 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48797980-9d34-437f-b735-3c9c8265ad85 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:10.819649 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-48797980-9d34-437f-b735-3c9c8265ad85 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:10.991124 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-48797980-9d34-437f-b735-3c9c8265ad85 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:10.999786 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-48797980-9d34-437f-b735-3c9c8265ad85 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:11.001383 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-48797980-9d34-437f-b735-3c9c8265ad85 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:11.002579 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-48797980-9d34-437f-b735-3c9c8265ad85 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.198632 Jul 04 09:25:11.003146 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 399/796] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:10 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:25:11.061225 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b5e81453-f1a0-40ee-a920-ec7779efe021 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:11.062264 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b5e81453-f1a0-40ee-a920-ec7779efe021 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:11.069344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5e81453-f1a0-40ee-a920-ec7779efe021 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:11.069912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5e81453-f1a0-40ee-a920-ec7779efe021 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:11.070816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5e81453-f1a0-40ee-a920-ec7779efe021 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:11.071330 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b5e81453-f1a0-40ee-a920-ec7779efe021 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:11.222004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b5e81453-f1a0-40ee-a920-ec7779efe021 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:11.230444 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b5e81453-f1a0-40ee-a920-ec7779efe021 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.174837 Jul 04 09:25:11.232818 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 400/797] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:11 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:12.020916 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0ce528c2-71bb-495e-a00c-7a1f7d9f753b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:12.021644 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0ce528c2-71bb-495e-a00c-7a1f7d9f753b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:12.028344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ce528c2-71bb-495e-a00c-7a1f7d9f753b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:12.028815 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ce528c2-71bb-495e-a00c-7a1f7d9f753b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:12.029689 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ce528c2-71bb-495e-a00c-7a1f7d9f753b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:12.030132 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ce528c2-71bb-495e-a00c-7a1f7d9f753b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:12.179659 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0ce528c2-71bb-495e-a00c-7a1f7d9f753b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:12.188434 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0ce528c2-71bb-495e-a00c-7a1f7d9f753b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:12.190223 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0ce528c2-71bb-495e-a00c-7a1f7d9f753b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:12.191651 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0ce528c2-71bb-495e-a00c-7a1f7d9f753b tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.174567 Jul 04 09:25:12.192352 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 401/798] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:12 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:25:12.248667 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6b7cd75c-392f-4140-be13-b24788d08598 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:12.249383 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6b7cd75c-392f-4140-be13-b24788d08598 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:12.255697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6b7cd75c-392f-4140-be13-b24788d08598 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:12.256160 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6b7cd75c-392f-4140-be13-b24788d08598 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:12.256951 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6b7cd75c-392f-4140-be13-b24788d08598 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:12.257437 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6b7cd75c-392f-4140-be13-b24788d08598 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:12.417145 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6b7cd75c-392f-4140-be13-b24788d08598 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:12.426065 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6b7cd75c-392f-4140-be13-b24788d08598 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.181769 Jul 04 09:25:12.429071 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 402/799] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:12 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:13.210275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d1b9eb99-b380-4706-9c13-bf27429fbaf8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:13.210970 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d1b9eb99-b380-4706-9c13-bf27429fbaf8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:13.219152 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d1b9eb99-b380-4706-9c13-bf27429fbaf8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:13.219609 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d1b9eb99-b380-4706-9c13-bf27429fbaf8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:13.220391 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d1b9eb99-b380-4706-9c13-bf27429fbaf8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:13.220854 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d1b9eb99-b380-4706-9c13-bf27429fbaf8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:13.361334 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d1b9eb99-b380-4706-9c13-bf27429fbaf8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:13.369339 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d1b9eb99-b380-4706-9c13-bf27429fbaf8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:13.370827 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d1b9eb99-b380-4706-9c13-bf27429fbaf8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:13.373127 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d1b9eb99-b380-4706-9c13-bf27429fbaf8 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.165648 Jul 04 09:25:13.373684 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 403/800] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:13 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:25:13.443387 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2190a43a-e7c5-423a-8a59-69d07585e8e8 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:13.443997 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2190a43a-e7c5-423a-8a59-69d07585e8e8 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:13.450868 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2190a43a-e7c5-423a-8a59-69d07585e8e8 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:13.451333 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2190a43a-e7c5-423a-8a59-69d07585e8e8 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:13.452108 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2190a43a-e7c5-423a-8a59-69d07585e8e8 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:13.452544 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2190a43a-e7c5-423a-8a59-69d07585e8e8 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:13.609755 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2190a43a-e7c5-423a-8a59-69d07585e8e8 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:13.616692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2190a43a-e7c5-423a-8a59-69d07585e8e8 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.177085 Jul 04 09:25:13.617448 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 404/801] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:13 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:14.343781 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-902890ce-3628-4add-837b-2eccdd2d25d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:14.344373 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-902890ce-3628-4add-837b-2eccdd2d25d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:14.352909 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-902890ce-3628-4add-837b-2eccdd2d25d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:14.353861 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-902890ce-3628-4add-837b-2eccdd2d25d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:14.354668 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-902890ce-3628-4add-837b-2eccdd2d25d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:14.355116 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-902890ce-3628-4add-837b-2eccdd2d25d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:14.358350 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:14.442895 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-902890ce-3628-4add-837b-2eccdd2d25d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lazy-loading 'services' on Instance uuid 80be812b-a9c3-4327-b55b-0dbcf97a12c7 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:25:14.521669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-902890ce-3628-4add-837b-2eccdd2d25d6 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "DELETE /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments/7e2dd987-a6f5-4ec8-bb77-e9256de2af70" status: 202 len: 0 microversion: 2.1 time: 0.182629 Jul 04 09:25:14.522261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 405/802] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:25:14 2022] DELETE /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments/7e2dd987-a6f5-4ec8-bb77-e9256de2af70 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:25:14.527557 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c7bd4607-a5d1-4605-bdaf-b30dd14f0bbc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:14.528883 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c7bd4607-a5d1-4605-bdaf-b30dd14f0bbc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:14.535448 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7bd4607-a5d1-4605-bdaf-b30dd14f0bbc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:14.535838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7bd4607-a5d1-4605-bdaf-b30dd14f0bbc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:14.536613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7bd4607-a5d1-4605-bdaf-b30dd14f0bbc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:14.537070 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c7bd4607-a5d1-4605-bdaf-b30dd14f0bbc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:14.671288 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c7bd4607-a5d1-4605-bdaf-b30dd14f0bbc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:14.679439 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c7bd4607-a5d1-4605-bdaf-b30dd14f0bbc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:14.680982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c7bd4607-a5d1-4605-bdaf-b30dd14f0bbc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:14.682246 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c7bd4607-a5d1-4605-bdaf-b30dd14f0bbc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.158749 Jul 04 09:25:14.682811 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 406/803] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:14 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:14.687907 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ad69eea6-9871-4ad2-ba6c-3b1ad1a40323 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:14.688900 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ad69eea6-9871-4ad2-ba6c-3b1ad1a40323 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:14.694975 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ad69eea6-9871-4ad2-ba6c-3b1ad1a40323 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:14.695432 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ad69eea6-9871-4ad2-ba6c-3b1ad1a40323 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:14.696199 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ad69eea6-9871-4ad2-ba6c-3b1ad1a40323 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:14.696642 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ad69eea6-9871-4ad2-ba6c-3b1ad1a40323 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:14.726622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ad69eea6-9871-4ad2-ba6c-3b1ad1a40323 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042780 Jul 04 09:25:14.727176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 407/804] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:14 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:14.731543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-296f238b-24d7-477e-9148-d82d5a4d0b0b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:14.732202 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-296f238b-24d7-477e-9148-d82d5a4d0b0b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:14.737966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-296f238b-24d7-477e-9148-d82d5a4d0b0b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:14.738426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-296f238b-24d7-477e-9148-d82d5a4d0b0b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:14.739191 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-296f238b-24d7-477e-9148-d82d5a4d0b0b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:14.739637 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-296f238b-24d7-477e-9148-d82d5a4d0b0b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:14.881738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-296f238b-24d7-477e-9148-d82d5a4d0b0b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:14.890504 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-296f238b-24d7-477e-9148-d82d5a4d0b0b tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.162371 Jul 04 09:25:14.891050 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 408/805] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:14 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:15.701401 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8652a0c5-df2d-48ba-91f9-6bb4e2e174af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:15.701980 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8652a0c5-df2d-48ba-91f9-6bb4e2e174af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:15.708248 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8652a0c5-df2d-48ba-91f9-6bb4e2e174af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:15.708715 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8652a0c5-df2d-48ba-91f9-6bb4e2e174af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:15.709532 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8652a0c5-df2d-48ba-91f9-6bb4e2e174af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:15.709983 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8652a0c5-df2d-48ba-91f9-6bb4e2e174af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:15.836857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8652a0c5-df2d-48ba-91f9-6bb4e2e174af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:15.845946 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8652a0c5-df2d-48ba-91f9-6bb4e2e174af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:15.847456 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8652a0c5-df2d-48ba-91f9-6bb4e2e174af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:15.848622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8652a0c5-df2d-48ba-91f9-6bb4e2e174af tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.151833 Jul 04 09:25:15.849211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 409/806] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:15 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:25:15.853676 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a8358268-632c-4767-92a3-c40d16c964a2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:15.854588 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a8358268-632c-4767-92a3-c40d16c964a2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:15.860400 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8358268-632c-4767-92a3-c40d16c964a2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:15.860862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8358268-632c-4767-92a3-c40d16c964a2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:15.861669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8358268-632c-4767-92a3-c40d16c964a2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:15.862113 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8358268-632c-4767-92a3-c40d16c964a2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:15.891703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a8358268-632c-4767-92a3-c40d16c964a2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Jul 04 09:25:15.892253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 410/807] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:15 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:15.907953 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d3a0f7e5-8728-432c-ad2f-cd094553afd3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:15.908575 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d3a0f7e5-8728-432c-ad2f-cd094553afd3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:15.914395 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3a0f7e5-8728-432c-ad2f-cd094553afd3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:15.914856 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3a0f7e5-8728-432c-ad2f-cd094553afd3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:15.915628 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3a0f7e5-8728-432c-ad2f-cd094553afd3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:15.916073 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d3a0f7e5-8728-432c-ad2f-cd094553afd3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:16.055264 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d3a0f7e5-8728-432c-ad2f-cd094553afd3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:16.063838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d3a0f7e5-8728-432c-ad2f-cd094553afd3 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1754 microversion: 2.1 time: 0.160408 Jul 04 09:25:16.064403 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 411/808] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:15 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:16.867240 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f29f6d2c-03c9-4203-b98f-0ea2072a11e7 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.842535 Jul 04 09:25:16.868123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-edea5ed6-4e37-4c9e-8856-d1afd1409ea2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:16.868748 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-edea5ed6-4e37-4c9e-8856-d1afd1409ea2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:16.872514 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 398/809] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:25:07 2022] POST /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments => generated 194 bytes in 9848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:16.876463 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edea5ed6-4e37-4c9e-8856-d1afd1409ea2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:16.876986 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edea5ed6-4e37-4c9e-8856-d1afd1409ea2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:16.877999 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edea5ed6-4e37-4c9e-8856-d1afd1409ea2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:16.878573 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-edea5ed6-4e37-4c9e-8856-d1afd1409ea2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:16.904334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b75e8aad-7ec0-4383-a6e4-5c9a70c95b68 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:16.905622 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b75e8aad-7ec0-4383-a6e4-5c9a70c95b68 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:16.911930 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b75e8aad-7ec0-4383-a6e4-5c9a70c95b68 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:16.912501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b75e8aad-7ec0-4383-a6e4-5c9a70c95b68 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:16.913520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b75e8aad-7ec0-4383-a6e4-5c9a70c95b68 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:16.914167 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b75e8aad-7ec0-4383-a6e4-5c9a70c95b68 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:16.945002 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b75e8aad-7ec0-4383-a6e4-5c9a70c95b68 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046180 Jul 04 09:25:16.945713 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 399/810] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:16 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:25:17.013739 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-edea5ed6-4e37-4c9e-8856-d1afd1409ea2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:17.021899 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-edea5ed6-4e37-4c9e-8856-d1afd1409ea2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:17.023321 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-edea5ed6-4e37-4c9e-8856-d1afd1409ea2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:17.024479 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-edea5ed6-4e37-4c9e-8856-d1afd1409ea2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.161323 Jul 04 09:25:17.025055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 412/811] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:16 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:17.080715 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-966cb76b-a35c-4922-a378-587946c86eab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:17.081352 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-966cb76b-a35c-4922-a378-587946c86eab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:17.087717 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-966cb76b-a35c-4922-a378-587946c86eab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:17.088165 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-966cb76b-a35c-4922-a378-587946c86eab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:17.088912 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-966cb76b-a35c-4922-a378-587946c86eab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:17.089372 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-966cb76b-a35c-4922-a378-587946c86eab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:17.234535 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-966cb76b-a35c-4922-a378-587946c86eab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:17.247833 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-966cb76b-a35c-4922-a378-587946c86eab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1757 microversion: 2.1 time: 0.170820 Jul 04 09:25:17.248429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 400/812] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:17 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:17.957636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2251a33f-578e-4cab-b726-204a4cfe52d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:17.958573 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2251a33f-578e-4cab-b726-204a4cfe52d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:17.965245 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2251a33f-578e-4cab-b726-204a4cfe52d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:17.966459 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2251a33f-578e-4cab-b726-204a4cfe52d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:17.967318 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2251a33f-578e-4cab-b726-204a4cfe52d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:17.968016 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2251a33f-578e-4cab-b726-204a4cfe52d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:17.996294 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2251a33f-578e-4cab-b726-204a4cfe52d2 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042750 Jul 04 09:25:17.996957 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 413/813] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:17 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:25:18.043018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-72f950b0-4159-4e6e-beea-000c719a36a7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:18.043716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-72f950b0-4159-4e6e-beea-000c719a36a7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:18.050329 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-72f950b0-4159-4e6e-beea-000c719a36a7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:18.050788 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-72f950b0-4159-4e6e-beea-000c719a36a7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:18.051559 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-72f950b0-4159-4e6e-beea-000c719a36a7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:18.051996 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-72f950b0-4159-4e6e-beea-000c719a36a7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:18.062931 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c69cfe23-7b1a-4805-908e-c269f6c10561 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:18.063826 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c69cfe23-7b1a-4805-908e-c269f6c10561 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:18.069699 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c69cfe23-7b1a-4805-908e-c269f6c10561 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:18.070160 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c69cfe23-7b1a-4805-908e-c269f6c10561 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:18.070933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c69cfe23-7b1a-4805-908e-c269f6c10561 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:18.071377 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c69cfe23-7b1a-4805-908e-c269f6c10561 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:18.098422 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c69cfe23-7b1a-4805-908e-c269f6c10561 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:25:18.191255 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c69cfe23-7b1a-4805-908e-c269f6c10561 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "DELETE /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 204 len: 0 microversion: 2.1 time: 0.131266 Jul 04 09:25:18.196456 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 414/814] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:25:18 2022] DELETE /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:25:18.203426 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a0721620-70fe-4df6-93f7-d84357b74624 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:18.204578 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a0721620-70fe-4df6-93f7-d84357b74624 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:18.206415 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-72f950b0-4159-4e6e-beea-000c719a36a7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:18.210839 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0721620-70fe-4df6-93f7-d84357b74624 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:18.211312 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0721620-70fe-4df6-93f7-d84357b74624 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:18.212099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0721620-70fe-4df6-93f7-d84357b74624 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:18.212539 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a0721620-70fe-4df6-93f7-d84357b74624 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:18.216115 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-72f950b0-4159-4e6e-beea-000c719a36a7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:18.218085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-72f950b0-4159-4e6e-beea-000c719a36a7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:18.219259 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-72f950b0-4159-4e6e-beea-000c719a36a7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.180177 Jul 04 09:25:18.219805 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 401/815] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:18 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:18.346379 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a0721620-70fe-4df6-93f7-d84357b74624 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:18.354114 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a0721620-70fe-4df6-93f7-d84357b74624 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1689 microversion: 2.1 time: 0.155791 Jul 04 09:25:18.354677 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 415/816] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:18 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:19.238346 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e29beb5c-53d9-4880-a997-24e1bded591e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:19.238988 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e29beb5c-53d9-4880-a997-24e1bded591e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:19.245377 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e29beb5c-53d9-4880-a997-24e1bded591e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:19.245826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e29beb5c-53d9-4880-a997-24e1bded591e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:19.246586 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e29beb5c-53d9-4880-a997-24e1bded591e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:19.247021 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e29beb5c-53d9-4880-a997-24e1bded591e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:19.371344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8928a8ef-133f-4489-bd1a-1fd13291a2a7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:19.372051 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8928a8ef-133f-4489-bd1a-1fd13291a2a7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:19.379238 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8928a8ef-133f-4489-bd1a-1fd13291a2a7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:19.379692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8928a8ef-133f-4489-bd1a-1fd13291a2a7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:19.380479 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8928a8ef-133f-4489-bd1a-1fd13291a2a7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:19.380916 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8928a8ef-133f-4489-bd1a-1fd13291a2a7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:19.392865 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e29beb5c-53d9-4880-a997-24e1bded591e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:19.403814 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e29beb5c-53d9-4880-a997-24e1bded591e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:19.406109 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e29beb5c-53d9-4880-a997-24e1bded591e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:19.407292 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e29beb5c-53d9-4880-a997-24e1bded591e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.172900 Jul 04 09:25:19.407858 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 402/817] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:19 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:19.511788 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8928a8ef-133f-4489-bd1a-1fd13291a2a7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:19.520181 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8928a8ef-133f-4489-bd1a-1fd13291a2a7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1689 microversion: 2.1 time: 0.152801 Jul 04 09:25:19.520782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 416/818] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:19 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:20.425823 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4b3feadd-a95e-4c9d-974e-1fa852f41c0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:20.426442 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4b3feadd-a95e-4c9d-974e-1fa852f41c0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:20.432987 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b3feadd-a95e-4c9d-974e-1fa852f41c0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:20.433474 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b3feadd-a95e-4c9d-974e-1fa852f41c0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:20.434249 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b3feadd-a95e-4c9d-974e-1fa852f41c0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:20.434691 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4b3feadd-a95e-4c9d-974e-1fa852f41c0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:20.539690 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dfc179a4-4ce4-4ad7-988d-d8095974edab tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:20.540961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dfc179a4-4ce4-4ad7-988d-d8095974edab tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:20.552532 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dfc179a4-4ce4-4ad7-988d-d8095974edab tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:20.552987 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dfc179a4-4ce4-4ad7-988d-d8095974edab tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:20.553795 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dfc179a4-4ce4-4ad7-988d-d8095974edab tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:20.554239 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dfc179a4-4ce4-4ad7-988d-d8095974edab tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:20.565001 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4b3feadd-a95e-4c9d-974e-1fa852f41c0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:20.567448 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:20.575172 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4b3feadd-a95e-4c9d-974e-1fa852f41c0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:20.576919 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4b3feadd-a95e-4c9d-974e-1fa852f41c0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:20.578187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4b3feadd-a95e-4c9d-974e-1fa852f41c0f tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.156247 Jul 04 09:25:20.578836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 403/819] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:20 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:25:20.687506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dfc179a4-4ce4-4ad7-988d-d8095974edab tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:20.695053 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dfc179a4-4ce4-4ad7-988d-d8095974edab tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1689 microversion: 2.1 time: 0.160686 Jul 04 09:25:20.695612 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 417/820] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:20 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:21.310366 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-bbb545c8-df60-4eae-abaf-1559864a0ea4 req-a5d522ef-780e-40e3-b9e1-e52e39773339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1af165-f9ff-409d-a80d-0998b4f545d9", "name": "network-vif-plugged", "status": "completed", "tag": "a2d58751-fbe0-49d6-b04c-2629ea26d8f4"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:21.322167 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-bbb545c8-df60-4eae-abaf-1559864a0ea4 req-a5d522ef-780e-40e3-b9e1-e52e39773339 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:21.322621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-bbb545c8-df60-4eae-abaf-1559864a0ea4 req-a5d522ef-780e-40e3-b9e1-e52e39773339 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:21.334293 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-bbb545c8-df60-4eae-abaf-1559864a0ea4 req-a5d522ef-780e-40e3-b9e1-e52e39773339 service nova] Creating event network-vif-plugged:a2d58751-fbe0-49d6-b04c-2629ea26d8f4 for instance fc1af165-f9ff-409d-a80d-0998b4f545d9 on hv-cinder-84456 Jul 04 09:25:21.339138 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-bbb545c8-df60-4eae-abaf-1559864a0ea4 req-a5d522ef-780e-40e3-b9e1-e52e39773339 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032546 Jul 04 09:25:21.339669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 404/821] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:21.598283 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-af50b862-dda0-4500-bd6f-c2c38d032766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:21.598850 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-af50b862-dda0-4500-bd6f-c2c38d032766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:21.605927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af50b862-dda0-4500-bd6f-c2c38d032766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:21.606389 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af50b862-dda0-4500-bd6f-c2c38d032766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:21.607164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af50b862-dda0-4500-bd6f-c2c38d032766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:21.608104 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-af50b862-dda0-4500-bd6f-c2c38d032766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:21.712465 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2a2b0793-be88-4961-acf6-69721af47e77 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:21.713296 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2a2b0793-be88-4961-acf6-69721af47e77 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:21.721081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a2b0793-be88-4961-acf6-69721af47e77 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:21.721539 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a2b0793-be88-4961-acf6-69721af47e77 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:21.722313 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a2b0793-be88-4961-acf6-69721af47e77 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:21.722753 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2a2b0793-be88-4961-acf6-69721af47e77 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:21.737553 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-af50b862-dda0-4500-bd6f-c2c38d032766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:21.745721 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-af50b862-dda0-4500-bd6f-c2c38d032766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:21.747354 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-af50b862-dda0-4500-bd6f-c2c38d032766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:21.749420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-af50b862-dda0-4500-bd6f-c2c38d032766 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.155835 Jul 04 09:25:21.750086 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 418/822] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:21 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:21.855017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-2a2b0793-be88-4961-acf6-69721af47e77 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:21.863388 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2a2b0793-be88-4961-acf6-69721af47e77 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1689 microversion: 2.1 time: 0.155576 Jul 04 09:25:21.863981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 405/823] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:21 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:22.767235 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-57fc7743-bc41-4781-aacc-f2ed3765c0a2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:22.768011 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-57fc7743-bc41-4781-aacc-f2ed3765c0a2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:22.774621 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57fc7743-bc41-4781-aacc-f2ed3765c0a2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:22.775154 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57fc7743-bc41-4781-aacc-f2ed3765c0a2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:22.775997 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57fc7743-bc41-4781-aacc-f2ed3765c0a2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:22.776447 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-57fc7743-bc41-4781-aacc-f2ed3765c0a2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:22.791842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:22.880069 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-851bc3ce-89d0-4864-8fba-b4080cea7d24 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:22.880662 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-851bc3ce-89d0-4864-8fba-b4080cea7d24 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:22.886863 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-851bc3ce-89d0-4864-8fba-b4080cea7d24 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:22.887550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-851bc3ce-89d0-4864-8fba-b4080cea7d24 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:22.888335 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-851bc3ce-89d0-4864-8fba-b4080cea7d24 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:22.888996 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-851bc3ce-89d0-4864-8fba-b4080cea7d24 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:22.915314 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-57fc7743-bc41-4781-aacc-f2ed3765c0a2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:22.924719 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-57fc7743-bc41-4781-aacc-f2ed3765c0a2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:22.926561 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-57fc7743-bc41-4781-aacc-f2ed3765c0a2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:22.927849 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-57fc7743-bc41-4781-aacc-f2ed3765c0a2 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.164757 Jul 04 09:25:22.928418 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 419/824] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:22 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:23.023409 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-851bc3ce-89d0-4864-8fba-b4080cea7d24 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:23.031482 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-851bc3ce-89d0-4864-8fba-b4080cea7d24 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1689 microversion: 2.1 time: 0.155527 Jul 04 09:25:23.032055 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 406/825] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:22 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:23.407044 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-cb30ea55-9b9f-47b8-a0c3-fbb64e60f896 req-f339cb53-bd6a-46d5-9a28-b6046710b4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80be812b-a9c3-4327-b55b-0dbcf97a12c7", "name": "network-vif-deleted", "tag": "57ace4f7-2cc2-4fa1-b912-fdb4c747abf3"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:23.410877 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:23.417244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-cb30ea55-9b9f-47b8-a0c3-fbb64e60f896 req-f339cb53-bd6a-46d5-9a28-b6046710b4b4 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:23.417796 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-cb30ea55-9b9f-47b8-a0c3-fbb64e60f896 req-f339cb53-bd6a-46d5-9a28-b6046710b4b4 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:23.433340 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-cb30ea55-9b9f-47b8-a0c3-fbb64e60f896 req-f339cb53-bd6a-46d5-9a28-b6046710b4b4 service nova] Creating event network-vif-deleted:57ace4f7-2cc2-4fa1-b912-fdb4c747abf3 for instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 on hv-cinder-84456 Jul 04 09:25:23.438712 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-cb30ea55-9b9f-47b8-a0c3-fbb64e60f896 req-f339cb53-bd6a-46d5-9a28-b6046710b4b4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098405 Jul 04 09:25:23.439453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 420/826] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:23.946546 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fcfb81f7-b7bd-46ff-9d5d-27b4599663c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:23.947619 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fcfb81f7-b7bd-46ff-9d5d-27b4599663c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:23.951026 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=50 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:23.956063 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fcfb81f7-b7bd-46ff-9d5d-27b4599663c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:23.956516 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fcfb81f7-b7bd-46ff-9d5d-27b4599663c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:23.957326 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fcfb81f7-b7bd-46ff-9d5d-27b4599663c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:23.957769 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fcfb81f7-b7bd-46ff-9d5d-27b4599663c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:24.048827 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-133a10c1-7043-46e9-9899-ac412453a14f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:24.050300 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-133a10c1-7043-46e9-9899-ac412453a14f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:24.060325 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-133a10c1-7043-46e9-9899-ac412453a14f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:24.061132 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-133a10c1-7043-46e9-9899-ac412453a14f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:24.062201 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-133a10c1-7043-46e9-9899-ac412453a14f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:24.062845 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-133a10c1-7043-46e9-9899-ac412453a14f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:24.154958 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-133a10c1-7043-46e9-9899-ac412453a14f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:24.162869 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fcfb81f7-b7bd-46ff-9d5d-27b4599663c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:24.165075 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-133a10c1-7043-46e9-9899-ac412453a14f tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 200 len: 1329 microversion: 2.1 time: 0.120591 Jul 04 09:25:24.166209 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 421/827] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:24 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 1329 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:24.172467 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fcfb81f7-b7bd-46ff-9d5d-27b4599663c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:24.173998 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fcfb81f7-b7bd-46ff-9d5d-27b4599663c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:24.175340 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fcfb81f7-b7bd-46ff-9d5d-27b4599663c1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1733 microversion: 2.20 time: 0.232956 Jul 04 09:25:24.175893 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 407/828] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:23 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1733 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:25:25.181550 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2535cb31-e8ac-4b72-a3bc-5fc03bb090e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:25.182101 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2535cb31-e8ac-4b72-a3bc-5fc03bb090e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 80be812b-a9c3-4327-b55b-0dbcf97a12c7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:25.189346 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2535cb31-e8ac-4b72-a3bc-5fc03bb090e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:25.189805 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2535cb31-e8ac-4b72-a3bc-5fc03bb090e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:25.190810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2535cb31-e8ac-4b72-a3bc-5fc03bb090e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:25.191296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2535cb31-e8ac-4b72-a3bc-5fc03bb090e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:25.194145 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b2a637c3-6849-426b-b392-1b38fe57e1db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:25.194789 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b2a637c3-6849-426b-b392-1b38fe57e1db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:25.201337 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2a637c3-6849-426b-b392-1b38fe57e1db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:25.202032 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2a637c3-6849-426b-b392-1b38fe57e1db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:25.202673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2a637c3-6849-426b-b392-1b38fe57e1db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:25.203113 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2a637c3-6849-426b-b392-1b38fe57e1db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:25.206543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-2535cb31-e8ac-4b72-a3bc-5fc03bb090e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] HTTP exception thrown: Instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 could not be found. Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2535cb31-e8ac-4b72-a3bc-5fc03bb090e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Request method failure captured: Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 HTTP/1.1 Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrDhJYSHwF3c__Nm79ScElVeUrXw69YhZNVmCicWRkTgUemaIH6UCHrTozU63At60joHPj-AnQrcYts2Iq0IA300fd3mzUxkEJgxvJPXN8qcGqHH5u7Ysi8XWtim28KiG_KJzF-pFl1_km8X6MSzoELVi4rQJFJasNBPBAsoJBv4d6w Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 930dc66606e94d9eb82cc50a67d009fb Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:25:25.208204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_930dc66606e94d9eb82cc50a67d009fb", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 930dc66606e94d9eb82cc50a67d009fb Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-ServerRescueNegativeTestJSON-20151059-project Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 9bcf554f3d6447399e1d9cfe08b0bff7 Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-ServerRescueNegativeTestJSON-20151059-project Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 could not be found. Jul 04 09:25:25.209906 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '80be812b-a9c3-4327-b55b-0dbcf97a12c7'} Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 could not be found. Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:25.210750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 could not be found. Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 could not be found. Jul 04 09:25:25.211992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:25.213117 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2535cb31-e8ac-4b72-a3bc-5fc03bb090e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Returning 404 to user: Instance 80be812b-a9c3-4327-b55b-0dbcf97a12c7 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:25.213117 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2535cb31-e8ac-4b72-a3bc-5fc03bb090e7 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7" status: 404 len: 111 microversion: 2.1 time: 0.032037 Jul 04 09:25:25.213117 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 422/829] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:25 2022] GET /compute/v2.1/servers/80be812b-a9c3-4327-b55b-0dbcf97a12c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:25.219249 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-697f449b-39ec-4f1f-9193-29db39bd3a15 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '.version_select at 0x7fad7aaa4280>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:25.238344 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-697f449b-39ec-4f1f-9193-29db39bd3a15 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-871394876" status: 202 len: 0 microversion: 2.1 time: 0.023676 Jul 04 09:25:25.238928 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 423/830] 10.222.0.71 () {58 vars in 1217 bytes} [Mon Jul 4 09:25:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-871394876 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:25:25.342868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b2a637c3-6849-426b-b392-1b38fe57e1db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:25.351372 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b2a637c3-6849-426b-b392-1b38fe57e1db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:25.352869 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b2a637c3-6849-426b-b392-1b38fe57e1db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:25.354103 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b2a637c3-6849-426b-b392-1b38fe57e1db tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1720 microversion: 2.20 time: 0.164298 Jul 04 09:25:25.354848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 408/831] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:25:25 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 09:25:25.434070 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-756573ba-95ea-4560-8466-d30d57a54450 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:25.435002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-756573ba-95ea-4560-8466-d30d57a54450 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:25.441936 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-756573ba-95ea-4560-8466-d30d57a54450 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:25.442394 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-756573ba-95ea-4560-8466-d30d57a54450 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:25.443170 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-756573ba-95ea-4560-8466-d30d57a54450 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:25.443611 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-756573ba-95ea-4560-8466-d30d57a54450 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:25.476533 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-756573ba-95ea-4560-8466-d30d57a54450 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Jul 04 09:25:25.477380 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 424/832] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:25 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:25.487582 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f6a08b64-e794-4a65-9cf0-9b95fe66286e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:25.488084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f6a08b64-e794-4a65-9cf0-9b95fe66286e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:25.494341 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f6a08b64-e794-4a65-9cf0-9b95fe66286e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:25.494800 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f6a08b64-e794-4a65-9cf0-9b95fe66286e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:25.495568 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f6a08b64-e794-4a65-9cf0-9b95fe66286e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:25.496008 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f6a08b64-e794-4a65-9cf0-9b95fe66286e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:25.524988 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f6a08b64-e794-4a65-9cf0-9b95fe66286e tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments/3a8c5ba3-ef70-4b97-a458-26df152adaec" status: 200 len: 194 microversion: 2.1 time: 0.041270 Jul 04 09:25:25.525618 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 409/833] 10.222.0.71 () {58 vars in 1412 bytes} [Mon Jul 4 09:25:25 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments/3a8c5ba3-ef70-4b97-a458-26df152adaec => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:26.848063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0e8c499b-41ef-4813-a290-def1a0fcab60 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "382e040e-26cf-4748-8335-f5815bce5ff6"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:26.849170 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0e8c499b-41ef-4813-a290-def1a0fcab60 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:26.855805 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0e8c499b-41ef-4813-a290-def1a0fcab60 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:26.856270 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0e8c499b-41ef-4813-a290-def1a0fcab60 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:26.857064 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0e8c499b-41ef-4813-a290-def1a0fcab60 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:26.858129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0e8c499b-41ef-4813-a290-def1a0fcab60 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:27.104495 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0e8c499b-41ef-4813-a290-def1a0fcab60 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "POST /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260338 Jul 04 09:25:27.105300 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 425/834] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:25:26 2022] POST /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:27.669939 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a5729c69-5ee9-4fc8-a6f9-42a607184294 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:27.670468 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a5729c69-5ee9-4fc8-a6f9-42a607184294 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:27.677562 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a5729c69-5ee9-4fc8-a6f9-42a607184294 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:27.678037 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a5729c69-5ee9-4fc8-a6f9-42a607184294 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:27.678803 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a5729c69-5ee9-4fc8-a6f9-42a607184294 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:27.679242 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a5729c69-5ee9-4fc8-a6f9-42a607184294 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:27.702345 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a5729c69-5ee9-4fc8-a6f9-42a607184294 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/ips" status: 200 len: 149 microversion: 2.1 time: 0.036290 Jul 04 09:25:27.703081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 410/835] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 4 09:25:27 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:28.170329 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c3ae45c9-930b-4ccd-ac3c-6f890b89409d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:28.170931 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c3ae45c9-930b-4ccd-ac3c-6f890b89409d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:28.178713 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c3ae45c9-930b-4ccd-ac3c-6f890b89409d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:28.179103 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c3ae45c9-930b-4ccd-ac3c-6f890b89409d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:28.179843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c3ae45c9-930b-4ccd-ac3c-6f890b89409d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:28.180339 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c3ae45c9-930b-4ccd-ac3c-6f890b89409d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:28.208529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c3ae45c9-930b-4ccd-ac3c-6f890b89409d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:25:28.286716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c3ae45c9-930b-4ccd-ac3c-6f890b89409d tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "DELETE /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 204 len: 0 microversion: 2.1 time: 0.120991 Jul 04 09:25:28.287315 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 426/836] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:25:28 2022] DELETE /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:25:28.296054 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fc67bcc3-47ae-493c-85ab-fa62f812efc1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:28.297605 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fc67bcc3-47ae-493c-85ab-fa62f812efc1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:28.304085 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc67bcc3-47ae-493c-85ab-fa62f812efc1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:28.304541 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc67bcc3-47ae-493c-85ab-fa62f812efc1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:28.305413 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc67bcc3-47ae-493c-85ab-fa62f812efc1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:28.305859 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fc67bcc3-47ae-493c-85ab-fa62f812efc1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:28.432683 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fc67bcc3-47ae-493c-85ab-fa62f812efc1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:28.440387 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fc67bcc3-47ae-493c-85ab-fa62f812efc1 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1506 microversion: 2.1 time: 0.148345 Jul 04 09:25:28.440961 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 411/837] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:28 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:29.021720 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0e85d1dd-611d-4a98-aa91-09b2acb4933e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "228978bf-3761-4417-87e0-4c4dd879702f"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:29.022934 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0e85d1dd-611d-4a98-aa91-09b2acb4933e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:29.029371 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0e85d1dd-611d-4a98-aa91-09b2acb4933e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:29.029824 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0e85d1dd-611d-4a98-aa91-09b2acb4933e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:29.030591 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0e85d1dd-611d-4a98-aa91-09b2acb4933e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:29.031391 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0e85d1dd-611d-4a98-aa91-09b2acb4933e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:29.458308 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6f6b248e-170c-4443-acbc-0634d8c8b280 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:29.459525 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6f6b248e-170c-4443-acbc-0634d8c8b280 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:29.466384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6f6b248e-170c-4443-acbc-0634d8c8b280 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:29.466836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6f6b248e-170c-4443-acbc-0634d8c8b280 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:29.467857 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6f6b248e-170c-4443-acbc-0634d8c8b280 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:29.468338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6f6b248e-170c-4443-acbc-0634d8c8b280 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:29.603998 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6f6b248e-170c-4443-acbc-0634d8c8b280 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:29.611537 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6f6b248e-170c-4443-acbc-0634d8c8b280 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1506 microversion: 2.1 time: 0.157490 Jul 04 09:25:29.612099 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 412/838] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:29 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:30.561485 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0e85d1dd-611d-4a98-aa91-09b2acb4933e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "POST /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.543933 Jul 04 09:25:30.564439 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 427/839] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 4 09:25:29 2022] POST /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments => generated 194 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:30.629796 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-56a6df5e-6180-4884-8da7-27ca3d158e78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:30.630408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-56a6df5e-6180-4884-8da7-27ca3d158e78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:30.637502 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56a6df5e-6180-4884-8da7-27ca3d158e78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:30.637956 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56a6df5e-6180-4884-8da7-27ca3d158e78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:30.638767 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56a6df5e-6180-4884-8da7-27ca3d158e78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:30.639246 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56a6df5e-6180-4884-8da7-27ca3d158e78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:30.771424 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-56a6df5e-6180-4884-8da7-27ca3d158e78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:30.779033 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-56a6df5e-6180-4884-8da7-27ca3d158e78 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 200 len: 1506 microversion: 2.1 time: 0.154354 Jul 04 09:25:30.779599 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 413/840] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:30 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:31.196623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-9c822a5d-6148-4428-875f-bcd63db8b925 req-c759ed7f-7c4e-46d4-b4b7-40f1dc9603f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308d33d7-4ded-4d69-80a0-d4c2f48394cd", "name": "network-vif-deleted", "tag": "0e681d8c-93d6-48fe-b3d5-a670e2d5dd33"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:31.208072 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-9c822a5d-6148-4428-875f-bcd63db8b925 req-c759ed7f-7c4e-46d4-b4b7-40f1dc9603f4 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:31.208631 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-9c822a5d-6148-4428-875f-bcd63db8b925 req-c759ed7f-7c4e-46d4-b4b7-40f1dc9603f4 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:31.224448 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-9c822a5d-6148-4428-875f-bcd63db8b925 req-c759ed7f-7c4e-46d4-b4b7-40f1dc9603f4 service nova] Creating event network-vif-deleted:0e681d8c-93d6-48fe-b3d5-a670e2d5dd33 for instance 308d33d7-4ded-4d69-80a0-d4c2f48394cd on hv-cinder-84456 Jul 04 09:25:31.230081 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-9c822a5d-6148-4428-875f-bcd63db8b925 req-c759ed7f-7c4e-46d4-b4b7-40f1dc9603f4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038893 Jul 04 09:25:31.230692 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 428/841] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:25:31.796701 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b44d797b-97c7-4328-b03e-0a7694d5f8bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:31.797283 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b44d797b-97c7-4328-b03e-0a7694d5f8bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: 308d33d7-4ded-4d69-80a0-d4c2f48394cd] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:31.804370 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b44d797b-97c7-4328-b03e-0a7694d5f8bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:31.804822 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b44d797b-97c7-4328-b03e-0a7694d5f8bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:31.805621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b44d797b-97c7-4328-b03e-0a7694d5f8bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:31.806067 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b44d797b-97c7-4328-b03e-0a7694d5f8bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:31.821104 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-b44d797b-97c7-4328-b03e-0a7694d5f8bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] HTTP exception thrown: Instance 308d33d7-4ded-4d69-80a0-d4c2f48394cd could not be found. Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b44d797b-97c7-4328-b03e-0a7694d5f8bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Request method failure captured: Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd HTTP/1.1 Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrDhJYSHwF3c__Nm79ScElVeUrXw69YhZNVmCicWRkTgUemaIH6UCHrTozU63At60joHPj-AnQrcYts2Iq0IA300fd3mzUxkEJgxvJPXN8qcGqHH5u7Ysi8XWtim28KiG_KJzF-pFl1_km8X6MSzoELVi4rQJFJasNBPBAsoJBv4d6w Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 930dc66606e94d9eb82cc50a67d009fb Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:25:31.822790 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_930dc66606e94d9eb82cc50a67d009fb", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 930dc66606e94d9eb82cc50a67d009fb Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-ServerRescueNegativeTestJSON-20151059-project Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 9bcf554f3d6447399e1d9cfe08b0bff7 Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-20151059-project Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 308d33d7-4ded-4d69-80a0-d4c2f48394cd could not be found. Jul 04 09:25:31.824261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '308d33d7-4ded-4d69-80a0-d4c2f48394cd'} Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 308d33d7-4ded-4d69-80a0-d4c2f48394cd could not be found. Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:31.825079 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 308d33d7-4ded-4d69-80a0-d4c2f48394cd could not be found. Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 308d33d7-4ded-4d69-80a0-d4c2f48394cd could not be found. Jul 04 09:25:31.826338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:31.827443 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b44d797b-97c7-4328-b03e-0a7694d5f8bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Returning 404 to user: Instance 308d33d7-4ded-4d69-80a0-d4c2f48394cd could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:31.827443 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b44d797b-97c7-4328-b03e-0a7694d5f8bf tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd" status: 404 len: 111 microversion: 2.1 time: 0.031511 Jul 04 09:25:31.827443 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 414/842] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:31 2022] GET /compute/v2.1/servers/308d33d7-4ded-4d69-80a0-d4c2f48394cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:31.833536 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-503dc18a-8139-42eb-84e6-cb74a8d841aa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:31.834128 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-503dc18a-8139-42eb-84e6-cb74a8d841aa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:31.840902 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-503dc18a-8139-42eb-84e6-cb74a8d841aa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:31.841387 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-503dc18a-8139-42eb-84e6-cb74a8d841aa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:31.842161 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-503dc18a-8139-42eb-84e6-cb74a8d841aa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:31.842851 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-503dc18a-8139-42eb-84e6-cb74a8d841aa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:31.868244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-503dc18a-8139-42eb-84e6-cb74a8d841aa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:25:31.943222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-503dc18a-8139-42eb-84e6-cb74a8d841aa tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "DELETE /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 204 len: 0 microversion: 2.1 time: 0.113617 Jul 04 09:25:31.943957 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 429/843] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:25:31 2022] DELETE /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:25:31.951970 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-179c468f-acde-4ea4-927b-07cc9bec0bb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:31.952600 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-179c468f-acde-4ea4-927b-07cc9bec0bb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:31.958776 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-179c468f-acde-4ea4-927b-07cc9bec0bb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:31.959228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-179c468f-acde-4ea4-927b-07cc9bec0bb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:31.959988 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-179c468f-acde-4ea4-927b-07cc9bec0bb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:31.960425 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-179c468f-acde-4ea4-927b-07cc9bec0bb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:32.088473 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-179c468f-acde-4ea4-927b-07cc9bec0bb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:32.097246 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-179c468f-acde-4ea4-927b-07cc9bec0bb8 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.149207 Jul 04 09:25:32.097871 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 415/844] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:31 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:33.167650 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a9b81a08-2389-45a8-8f8b-63e9c246980c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:33.168359 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a9b81a08-2389-45a8-8f8b-63e9c246980c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:33.175051 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9b81a08-2389-45a8-8f8b-63e9c246980c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:33.175509 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9b81a08-2389-45a8-8f8b-63e9c246980c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:33.176388 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9b81a08-2389-45a8-8f8b-63e9c246980c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:33.176830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9b81a08-2389-45a8-8f8b-63e9c246980c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:33.328836 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a9b81a08-2389-45a8-8f8b-63e9c246980c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:33.336519 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a9b81a08-2389-45a8-8f8b-63e9c246980c tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.226006 Jul 04 09:25:33.337103 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 430/845] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:33 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:34.354952 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e269b6da-1ecb-4c5c-8b59-14be84bbc7cb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:34.355586 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e269b6da-1ecb-4c5c-8b59-14be84bbc7cb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:34.362629 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e269b6da-1ecb-4c5c-8b59-14be84bbc7cb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:34.363074 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e269b6da-1ecb-4c5c-8b59-14be84bbc7cb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:34.363830 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e269b6da-1ecb-4c5c-8b59-14be84bbc7cb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:34.364262 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e269b6da-1ecb-4c5c-8b59-14be84bbc7cb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:34.491628 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e269b6da-1ecb-4c5c-8b59-14be84bbc7cb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:34.499762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e269b6da-1ecb-4c5c-8b59-14be84bbc7cb tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.148658 Jul 04 09:25:34.500336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 416/846] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:34 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:35.516894 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-aaadd470-361a-4746-91d2-287670ccdbd5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:35.518013 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-aaadd470-361a-4746-91d2-287670ccdbd5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:35.524543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aaadd470-361a-4746-91d2-287670ccdbd5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:35.525023 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aaadd470-361a-4746-91d2-287670ccdbd5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:35.525827 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aaadd470-361a-4746-91d2-287670ccdbd5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:35.526273 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-aaadd470-361a-4746-91d2-287670ccdbd5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:35.665616 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-aaadd470-361a-4746-91d2-287670ccdbd5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:35.673076 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-aaadd470-361a-4746-91d2-287670ccdbd5 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1522 microversion: 2.1 time: 0.160129 Jul 04 09:25:35.674212 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 431/847] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:35 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:36.600871 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-e9231081-d616-4be8-8113-20eeee27d07c req-e3d351eb-df9d-4723-85fb-d0a3a9a9d005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce", "name": "network-vif-deleted", "tag": "d5b73245-e47b-42e3-85c3-556ad9093933"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:36.615833 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e9231081-d616-4be8-8113-20eeee27d07c req-e3d351eb-df9d-4723-85fb-d0a3a9a9d005 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:36.616347 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e9231081-d616-4be8-8113-20eeee27d07c req-e3d351eb-df9d-4723-85fb-d0a3a9a9d005 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:36.631557 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-e9231081-d616-4be8-8113-20eeee27d07c req-e3d351eb-df9d-4723-85fb-d0a3a9a9d005 service nova] Creating event network-vif-deleted:d5b73245-e47b-42e3-85c3-556ad9093933 for instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce on hv-cinder-84456 Jul 04 09:25:36.637808 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-e9231081-d616-4be8-8113-20eeee27d07c req-e3d351eb-df9d-4723-85fb-d0a3a9a9d005 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040714 Jul 04 09:25:36.638414 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 417/848] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:25:36.692957 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:36.693762 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:36.700451 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:36.700910 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:36.701727 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:36.702174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:36.730226 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e35fbb8d-f2cf-434b-a344-6709db14dbde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:36.731270 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e35fbb8d-f2cf-434b-a344-6709db14dbde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:36.738261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e35fbb8d-f2cf-434b-a344-6709db14dbde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:36.738696 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e35fbb8d-f2cf-434b-a344-6709db14dbde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:36.739492 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e35fbb8d-f2cf-434b-a344-6709db14dbde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:36.739933 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e35fbb8d-f2cf-434b-a344-6709db14dbde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:36.747345 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:36.747822 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:36.748346 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lazy-loading 'fault' on Instance uuid be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:25:36.771295 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e35fbb8d-f2cf-434b-a344-6709db14dbde tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045373 Jul 04 09:25:36.771870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 418/849] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:36 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:25:36.792267 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bcf554f3d6447399e1d9cfe08b0bff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dc66606e94d9eb82cc50a67d009fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:36.794644 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:36.802678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c8ec9092-2335-484b-a559-930f68ffa007 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 200 len: 1312 microversion: 2.1 time: 0.115652 Jul 04 09:25:36.803275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 432/850] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:36 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:36.916305 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8e79fe19-6f25-42d4-b736-51452e32d810 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:36.916880 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8e79fe19-6f25-42d4-b736-51452e32d810 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:36.924597 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e79fe19-6f25-42d4-b736-51452e32d810 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:36.925091 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e79fe19-6f25-42d4-b736-51452e32d810 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:36.926207 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e79fe19-6f25-42d4-b736-51452e32d810 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:36.926660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8e79fe19-6f25-42d4-b736-51452e32d810 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:36.957712 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8e79fe19-6f25-42d4-b736-51452e32d810 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments/3a8c5ba3-ef70-4b97-a458-26df152adaec" status: 200 len: 194 microversion: 2.1 time: 0.045964 Jul 04 09:25:36.958321 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 419/851] 10.222.0.71 () {58 vars in 1412 bytes} [Mon Jul 4 09:25:36 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments/3a8c5ba3-ef70-4b97-a458-26df152adaec => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:36.968274 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8fae7b7e-44c6-4e19-b006-2d1427ebd68b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:36.968774 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8fae7b7e-44c6-4e19-b006-2d1427ebd68b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:36.976743 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8fae7b7e-44c6-4e19-b006-2d1427ebd68b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:36.977237 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8fae7b7e-44c6-4e19-b006-2d1427ebd68b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:36.978020 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8fae7b7e-44c6-4e19-b006-2d1427ebd68b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:36.978460 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8fae7b7e-44c6-4e19-b006-2d1427ebd68b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:37.067124 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-8fae7b7e-44c6-4e19-b006-2d1427ebd68b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lazy-loading 'services' on Instance uuid faf3ecbe-ac29-4c45-a385-f8fa5c699e5d {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:25:37.140440 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8fae7b7e-44c6-4e19-b006-2d1427ebd68b tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "DELETE /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments/3a8c5ba3-ef70-4b97-a458-26df152adaec" status: 202 len: 0 microversion: 2.1 time: 0.176176 Jul 04 09:25:37.141200 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 433/852] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:25:36 2022] DELETE /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments/3a8c5ba3-ef70-4b97-a458-26df152adaec => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:25:37.819616 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f4182872-e7a0-443b-b05b-190c11527900 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:37.820232 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f4182872-e7a0-443b-b05b-190c11527900 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] [instance: be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:37.826749 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4182872-e7a0-443b-b05b-190c11527900 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:37.827202 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4182872-e7a0-443b-b05b-190c11527900 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:37.827992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4182872-e7a0-443b-b05b-190c11527900 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:37.828432 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f4182872-e7a0-443b-b05b-190c11527900 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:37.842491 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-f4182872-e7a0-443b-b05b-190c11527900 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] HTTP exception thrown: Instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce could not be found. Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f4182872-e7a0-443b-b05b-190c11527900 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Request method failure captured: Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce HTTP/1.1 Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrDhJYSHwF3c__Nm79ScElVeUrXw69YhZNVmCicWRkTgUemaIH6UCHrTozU63At60joHPj-AnQrcYts2Iq0IA300fd3mzUxkEJgxvJPXN8qcGqHH5u7Ysi8XWtim28KiG_KJzF-pFl1_km8X6MSzoELVi4rQJFJasNBPBAsoJBv4d6w Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 930dc66606e94d9eb82cc50a67d009fb Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:25:37.844360 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/930dc66606e94d9eb82cc50a67d009fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_930dc66606e94d9eb82cc50a67d009fb", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 930dc66606e94d9eb82cc50a67d009fb Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-20151059 Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-ServerRescueNegativeTestJSON-20151059-project Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 9bcf554f3d6447399e1d9cfe08b0bff7 Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-20151059-project Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce could not be found. Jul 04 09:25:37.846334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce'} Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce could not be found. Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:37.847196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce could not be found. Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce could not be found. Jul 04 09:25:37.848870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:37.850209 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f4182872-e7a0-443b-b05b-190c11527900 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] Returning 404 to user: Instance be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:37.850209 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f4182872-e7a0-443b-b05b-190c11527900 tempest-ServerRescueNegativeTestJSON-20151059 tempest-ServerRescueNegativeTestJSON-20151059-project] 10.222.0.71 "GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce" status: 404 len: 111 microversion: 2.1 time: 0.030534 Jul 04 09:25:37.850209 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 420/853] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:37 2022] GET /compute/v2.1/servers/be0e7360-ba96-4b8c-a8f8-4dbf62eeb0ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:25:42.475427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c87c36a1-0cf4-435c-bb09-a9ec856de22f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Action: 'create', calling method: .version_select at 0x7fad7aaa4a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-417878411"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:42.771845 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c87c36a1-0cf4-435c-bb09-a9ec856de22f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.412834 Jul 04 09:25:42.772480 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 434/854] 10.222.0.71 () {60 vars in 1154 bytes} [Mon Jul 4 09:25:42 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 414 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 04 09:25:42.783632 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-99b81f36-3d39-4834-8a44-f478900ba3c7 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7ac35a60>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:42.834011 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-99b81f36-3d39-4834-8a44-f478900ba3c7 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765" status: 200 len: 344 microversion: 2.1 time: 0.054498 Jul 04 09:25:42.834674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 421/855] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:25:42 2022] GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:43.453094 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5f68d9b9-cb66-43d2-a0a6-060d36eb007a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:43.453718 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5f68d9b9-cb66-43d2-a0a6-060d36eb007a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:43.460314 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f68d9b9-cb66-43d2-a0a6-060d36eb007a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:43.460779 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f68d9b9-cb66-43d2-a0a6-060d36eb007a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:43.461586 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f68d9b9-cb66-43d2-a0a6-060d36eb007a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:43.462028 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5f68d9b9-cb66-43d2-a0a6-060d36eb007a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:43.551913 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-5f68d9b9-cb66-43d2-a0a6-060d36eb007a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lazy-loading 'services' on Instance uuid 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:25:43.598711 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5484495f-985f-49b4-a290-59366bc0d5f8 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:43.599538 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-5484495f-985f-49b4-a290-59366bc0d5f8 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:43.605631 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5484495f-985f-49b4-a290-59366bc0d5f8 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:43.606067 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5484495f-985f-49b4-a290-59366bc0d5f8 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:43.606847 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5484495f-985f-49b4-a290-59366bc0d5f8 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:43.607356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-5484495f-985f-49b4-a290-59366bc0d5f8 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:43.639536 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5f68d9b9-cb66-43d2-a0a6-060d36eb007a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments/228978bf-3761-4417-87e0-4c4dd879702f" status: 202 len: 0 microversion: 2.1 time: 0.190634 Jul 04 09:25:43.640519 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 435/856] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:25:43 2022] DELETE /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments/228978bf-3761-4417-87e0-4c4dd879702f => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:25:43.643742 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5484495f-985f-49b4-a290-59366bc0d5f8 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments/382e040e-26cf-4748-8335-f5815bce5ff6" status: 200 len: 194 microversion: 2.1 time: 0.049120 Jul 04 09:25:43.644338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 422/857] 10.222.0.71 () {58 vars in 1412 bytes} [Mon Jul 4 09:25:43 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments/382e040e-26cf-4748-8335-f5815bce5ff6 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:25:43.649433 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8f21fa04-6871-47c9-a943-f83b01faaacf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:43.650429 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8f21fa04-6871-47c9-a943-f83b01faaacf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:43.655694 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7e1ecdf7-d25d-4573-9652-5d40f44764e2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:43.656346 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7e1ecdf7-d25d-4573-9652-5d40f44764e2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:43.656696 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8f21fa04-6871-47c9-a943-f83b01faaacf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:43.657187 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8f21fa04-6871-47c9-a943-f83b01faaacf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:43.658567 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8f21fa04-6871-47c9-a943-f83b01faaacf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:43.659014 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8f21fa04-6871-47c9-a943-f83b01faaacf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:43.665495 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7e1ecdf7-d25d-4573-9652-5d40f44764e2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:43.665896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7e1ecdf7-d25d-4573-9652-5d40f44764e2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:43.666684 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7e1ecdf7-d25d-4573-9652-5d40f44764e2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:43.667122 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7e1ecdf7-d25d-4573-9652-5d40f44764e2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:43.690175 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8f21fa04-6871-47c9-a943-f83b01faaacf tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044955 Jul 04 09:25:43.690748 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 436/858] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:43 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:43.751684 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-7e1ecdf7-d25d-4573-9652-5d40f44764e2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lazy-loading 'services' on Instance uuid faf3ecbe-ac29-4c45-a385-f8fa5c699e5d {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:25:43.812209 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=100 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:43.823377 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7e1ecdf7-d25d-4573-9652-5d40f44764e2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "DELETE /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments/382e040e-26cf-4748-8335-f5815bce5ff6" status: 202 len: 0 microversion: 2.1 time: 0.173429 Jul 04 09:25:43.823953 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 423/859] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:25:43 2022] DELETE /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments/382e040e-26cf-4748-8335-f5815bce5ff6 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:25:43.847478 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cebb89ad-eb47-44eb-879d-a6966ef9aa07 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7a9b5700>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:43.894976 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cebb89ad-eb47-44eb-879d-a6966ef9aa07 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765" status: 200 len: 345 microversion: 2.1 time: 0.052364 Jul 04 09:25:43.895553 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 437/860] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:25:43 2022] GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:43.907050 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b49ac487-8248-4a98-82ee-471b4c7e4ed8 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Action: 'create', calling method: .version_select at 0x7fad7ac1c550>, body: {"snapshot": {"volume_id": "6be9d1a4-4d89-4006-93e6-fdbd8fb86765", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1503751405"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:44.051561 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b49ac487-8248-4a98-82ee-471b4c7e4ed8 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.148620 Jul 04 09:25:44.053069 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 424/861] 10.222.0.71 () {60 vars in 1161 bytes} [Mon Jul 4 09:25:43 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:44.063395 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-79801848-df8c-4c9c-9bc3-a303749f8c6e tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7aa939d0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:44.099788 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-79801848-df8c-4c9c-9bc3-a303749f8c6e tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4" status: 200 len: 287 microversion: 2.1 time: 0.041306 Jul 04 09:25:44.100443 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 438/862] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 4 09:25:44 2022] GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:44.110161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-21ef588a-7797-4cf0-9c15-b21e9467d816 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7aa678b0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:44.155392 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-21ef588a-7797-4cf0-9c15-b21e9467d816 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.048913 Jul 04 09:25:44.155954 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 425/863] 10.222.0.71 () {58 vars in 1139 bytes} [Mon Jul 4 09:25:44 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:44.166057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-096e0491-468f-4c53-9ca9-3e3fd6e080b7 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7ad77c10>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:44.197947 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-096e0491-468f-4c53-9ca9-3e3fd6e080b7 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4" status: 200 len: 287 microversion: 2.1 time: 0.035473 Jul 04 09:25:44.202238 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 439/864] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 4 09:25:44 2022] GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:44.702196 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a0658cb3-bd9d-49b4-95b1-3bdfe039c500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:44.703142 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a0658cb3-bd9d-49b4-95b1-3bdfe039c500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:44.710369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0658cb3-bd9d-49b4-95b1-3bdfe039c500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:44.710828 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0658cb3-bd9d-49b4-95b1-3bdfe039c500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:44.711602 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0658cb3-bd9d-49b4-95b1-3bdfe039c500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:44.712048 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a0658cb3-bd9d-49b4-95b1-3bdfe039c500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:44.741840 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a0658cb3-bd9d-49b4-95b1-3bdfe039c500 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043756 Jul 04 09:25:44.742389 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 426/865] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:44 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:45.211327 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a5d6a224-51c2-4390-b50b-69da39292c1b tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7a9b5280>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:45.240141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a5d6a224-51c2-4390-b50b-69da39292c1b tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4" status: 200 len: 287 microversion: 2.1 time: 0.033059 Jul 04 09:25:45.240705 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 440/866] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 4 09:25:45 2022] GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:45.753899 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1a6dab57-e23e-41fd-bcae-4142727fa80e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:45.754856 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1a6dab57-e23e-41fd-bcae-4142727fa80e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:45.761353 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a6dab57-e23e-41fd-bcae-4142727fa80e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:45.761809 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a6dab57-e23e-41fd-bcae-4142727fa80e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:45.762577 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a6dab57-e23e-41fd-bcae-4142727fa80e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:45.763018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1a6dab57-e23e-41fd-bcae-4142727fa80e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:45.791862 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1a6dab57-e23e-41fd-bcae-4142727fa80e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042540 Jul 04 09:25:45.792409 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 427/867] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:45 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:46.252363 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dfb0e225-515e-4f02-bf2e-b41ad233d141 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7ab773a0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:46.281733 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dfb0e225-515e-4f02-bf2e-b41ad233d141 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4" status: 200 len: 287 microversion: 2.1 time: 0.034080 Jul 04 09:25:46.282386 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 441/868] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 4 09:25:46 2022] GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:46.803648 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-37a1d4b2-9615-4a46-927b-030dc26dc5ce tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:46.804571 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-37a1d4b2-9615-4a46-927b-030dc26dc5ce tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:46.811129 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37a1d4b2-9615-4a46-927b-030dc26dc5ce tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:46.811577 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37a1d4b2-9615-4a46-927b-030dc26dc5ce tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:46.812332 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37a1d4b2-9615-4a46-927b-030dc26dc5ce tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:46.812770 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37a1d4b2-9615-4a46-927b-030dc26dc5ce tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:46.842314 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-37a1d4b2-9615-4a46-927b-030dc26dc5ce tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042656 Jul 04 09:25:46.843131 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 428/869] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:46 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:47.295667 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a22432fe-6c88-4d24-b32b-25445149d9fc tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7aaa4550>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:47.328721 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a22432fe-6c88-4d24-b32b-25445149d9fc tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4" status: 200 len: 288 microversion: 2.1 time: 0.038208 Jul 04 09:25:47.329404 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 442/870] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 4 09:25:47 2022] GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:47.340026 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-5ef9c776-9345-4a50-aef3-b0e478adccec tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7aa060d0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:47.399739 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-5ef9c776-9345-4a50-aef3-b0e478adccec tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "DELETE /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4" status: 202 len: 0 microversion: 2.1 time: 0.063425 Jul 04 09:25:47.400312 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 429/871] 10.222.0.71 () {58 vars in 1253 bytes} [Mon Jul 4 09:25:47 2022] DELETE /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:25:47.409171 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b7613c9c-709a-4ba8-ad39-e17ea6775f33 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7ab77430>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:47.439607 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b7613c9c-709a-4ba8-ad39-e17ea6775f33 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4" status: 200 len: 287 microversion: 2.1 time: 0.034507 Jul 04 09:25:47.440167 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 443/872] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 4 09:25:47 2022] GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:47.855065 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e434461e-d936-4eef-af17-2b75f0f977ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:47.855985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e434461e-d936-4eef-af17-2b75f0f977ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:47.862923 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e434461e-d936-4eef-af17-2b75f0f977ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:47.863372 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e434461e-d936-4eef-af17-2b75f0f977ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:47.864143 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e434461e-d936-4eef-af17-2b75f0f977ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:47.864586 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e434461e-d936-4eef-af17-2b75f0f977ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:47.891820 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e434461e-d936-4eef-af17-2b75f0f977ec tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041260 Jul 04 09:25:47.892365 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 430/873] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:47 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:25:47.952959 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-125649a5-1061-4f7e-b366-9bcf6b49923d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:47.953605 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-125649a5-1061-4f7e-b366-9bcf6b49923d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:47.959931 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-125649a5-1061-4f7e-b366-9bcf6b49923d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:47.960401 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-125649a5-1061-4f7e-b366-9bcf6b49923d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:47.961244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-125649a5-1061-4f7e-b366-9bcf6b49923d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:47.961689 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-125649a5-1061-4f7e-b366-9bcf6b49923d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:47.987383 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-125649a5-1061-4f7e-b366-9bcf6b49923d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:25:48.067123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-125649a5-1061-4f7e-b366-9bcf6b49923d tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 204 len: 0 microversion: 2.1 time: 0.117873 Jul 04 09:25:48.067856 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 444/874] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:25:47 2022] DELETE /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 09:25:48.076354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f2e47945-053e-469d-8009-ba4065375c6c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:48.077150 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f2e47945-053e-469d-8009-ba4065375c6c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:48.083807 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2e47945-053e-469d-8009-ba4065375c6c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:48.084260 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2e47945-053e-469d-8009-ba4065375c6c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:48.085221 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2e47945-053e-469d-8009-ba4065375c6c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:48.085663 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f2e47945-053e-469d-8009-ba4065375c6c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:48.147480 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e23ea1ac-446a-49cb-b976-00c2c376af40 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:48.148533 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e23ea1ac-446a-49cb-b976-00c2c376af40 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:48.154567 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e23ea1ac-446a-49cb-b976-00c2c376af40 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:48.155017 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e23ea1ac-446a-49cb-b976-00c2c376af40 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:48.155785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e23ea1ac-446a-49cb-b976-00c2c376af40 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:48.156229 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e23ea1ac-446a-49cb-b976-00c2c376af40 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:48.187514 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e23ea1ac-446a-49cb-b976-00c2c376af40 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044379 Jul 04 09:25:48.188060 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 445/875] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:48 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 09:25:48.228219 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f2e47945-053e-469d-8009-ba4065375c6c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:48.235721 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f2e47945-053e-469d-8009-ba4065375c6c tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1679 microversion: 2.1 time: 0.163148 Jul 04 09:25:48.236274 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 431/876] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:48 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:48.295153 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-cd178507-647c-4fa8-9a24-d2e02eff81d1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:48.296002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-cd178507-647c-4fa8-9a24-d2e02eff81d1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:48.303458 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd178507-647c-4fa8-9a24-d2e02eff81d1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:48.303919 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd178507-647c-4fa8-9a24-d2e02eff81d1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:48.304696 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd178507-647c-4fa8-9a24-d2e02eff81d1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:48.305175 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-cd178507-647c-4fa8-9a24-d2e02eff81d1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:48.333004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-cd178507-647c-4fa8-9a24-d2e02eff81d1 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041776 Jul 04 09:25:48.333606 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 446/877] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:25:48 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 09:25:48.390281 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-31a03185-ed2a-4f78-93e6-90aa934898a6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:48.390777 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-31a03185-ed2a-4f78-93e6-90aa934898a6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:48.397144 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31a03185-ed2a-4f78-93e6-90aa934898a6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:48.397597 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31a03185-ed2a-4f78-93e6-90aa934898a6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:48.398362 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31a03185-ed2a-4f78-93e6-90aa934898a6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:48.398803 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-31a03185-ed2a-4f78-93e6-90aa934898a6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:48.426292 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-31a03185-ed2a-4f78-93e6-90aa934898a6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:25:48.451269 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3f719d00-018c-43f4-9c22-1455977750c3 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7aa5b0d0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:48.479688 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-3f719d00-018c-43f4-9c22-1455977750c3 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] HTTP exception thrown: Snapshot 27ecde3e-57f1-42cd-98c1-103a8dad52f4 could not be found. Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3f719d00-018c-43f4-9c22-1455977750c3 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Request method failure captured: Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4 HTTP/1.1 Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrIW05NStqG_ev2FdYEX54HQfYf7Re5ePiAzsRtqOpyAYeiYeBJcA2IJ93Ip83hnG1PX0o2GlkHooG-j0-Z4_mUtEhDquGvoMrsoaIM9SBy8YYsIpIDpK_ideBJ1flA1X4qHrBg1WEO9XjwjSN4p2-9QQd1cCI4u9CINPlpLQnGUPKc Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 6df585d8538848e2a82604efefb49dc9 Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:25:48.482253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_6df585d8538848e2a82604efefb49dc9", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 6df585d8538848e2a82604efefb49dc9 Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesSnapshotsTestJSON-1814324056-project Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 86c3e25fa55b4719bdebf7397dea65d6 Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814324056-project Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Snapshot 27ecde3e-57f1-42cd-98c1-103a8dad52f4 could not be found. Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '27ecde3e-57f1-42cd-98c1-103a8dad52f4'} Jul 04 09:25:48.484204 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 27ecde3e-57f1-42cd-98c1-103a8dad52f4 could not be found. (HTTP 404) (Request-ID: req-c00b1d16-9521-4a71-8ecf-90fcbe277cb6) Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:48.485296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:25:48.486775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 27ecde3e-57f1-42cd-98c1-103a8dad52f4 could not be found. Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 04 09:25:48.489198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 27ecde3e-57f1-42cd-98c1-103a8dad52f4 could not be found. Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 27ecde3e-57f1-42cd-98c1-103a8dad52f4 could not be found. Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3f719d00-018c-43f4-9c22-1455977750c3 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Returning 404 to user: Snapshot 27ecde3e-57f1-42cd-98c1-103a8dad52f4 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:48.490842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3f719d00-018c-43f4-9c22-1455977750c3 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4" status: 404 len: 111 microversion: 2.1 time: 0.036283 Jul 04 09:25:48.491881 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 447/878] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 4 09:25:48 2022] GET /compute/v2.1/os-snapshots/27ecde3e-57f1-42cd-98c1-103a8dad52f4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:25:48.493712 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f8c5d8f5-7276-46e1-a910-90c2ccd8d24f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7aaa41f0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:48.503165 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-31a03185-ed2a-4f78-93e6-90aa934898a6 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "DELETE /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 204 len: 0 microversion: 2.1 time: 0.116271 Jul 04 09:25:48.503766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 432/879] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:25:48 2022] DELETE /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:25:48.512765 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-84de3bfb-df27-411c-b80b-ed0669a73633 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:48.513553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-84de3bfb-df27-411c-b80b-ed0669a73633 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:48.520523 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84de3bfb-df27-411c-b80b-ed0669a73633 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:48.520983 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84de3bfb-df27-411c-b80b-ed0669a73633 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:48.521828 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84de3bfb-df27-411c-b80b-ed0669a73633 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:48.522363 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-84de3bfb-df27-411c-b80b-ed0669a73633 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:48.563529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f8c5d8f5-7276-46e1-a910-90c2ccd8d24f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765" status: 202 len: 0 microversion: 2.1 time: 0.073587 Jul 04 09:25:48.564103 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 448/880] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 4 09:25:48 2022] DELETE /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:25:48.572040 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b314a71b-5647-476f-a890-6973a74dd36e tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7aa50ee0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:48.621427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b314a71b-5647-476f-a890-6973a74dd36e tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765" status: 200 len: 344 microversion: 2.1 time: 0.052979 Jul 04 09:25:48.621996 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 449/881] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:25:48 2022] GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:48.657831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-84de3bfb-df27-411c-b80b-ed0669a73633 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:48.666170 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-84de3bfb-df27-411c-b80b-ed0669a73633 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1673 microversion: 2.1 time: 0.158006 Jul 04 09:25:48.666730 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 433/882] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:48 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:49.254937 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-08b2097c-3d27-4625-b206-e407803a0b6e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:49.255562 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-08b2097c-3d27-4625-b206-e407803a0b6e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:49.261672 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-08b2097c-3d27-4625-b206-e407803a0b6e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:49.262130 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-08b2097c-3d27-4625-b206-e407803a0b6e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:49.262894 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-08b2097c-3d27-4625-b206-e407803a0b6e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:49.263336 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-08b2097c-3d27-4625-b206-e407803a0b6e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:49.389481 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-08b2097c-3d27-4625-b206-e407803a0b6e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:49.397698 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-08b2097c-3d27-4625-b206-e407803a0b6e tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1679 microversion: 2.1 time: 0.147572 Jul 04 09:25:49.398284 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 450/883] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:49 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:49.634467 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-91b5d9de-4927-4449-8fc8-6b5dadd2a09f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7ac1c550>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:49.663088 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-91b5d9de-4927-4449-8fc8-6b5dadd2a09f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] HTTP exception thrown: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-91b5d9de-4927-4449-8fc8-6b5dadd2a09f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Request method failure captured: Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765 HTTP/1.1 Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrIW05NStqG_ev2FdYEX54HQfYf7Re5ePiAzsRtqOpyAYeiYeBJcA2IJ93Ip83hnG1PX0o2GlkHooG-j0-Z4_mUtEhDquGvoMrsoaIM9SBy8YYsIpIDpK_ideBJ1flA1X4qHrBg1WEO9XjwjSN4p2-9QQd1cCI4u9CINPlpLQnGUPKc Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 6df585d8538848e2a82604efefb49dc9 Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:25:49.665185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_6df585d8538848e2a82604efefb49dc9", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 6df585d8538848e2a82604efefb49dc9 Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesSnapshotsTestJSON-1814324056-project Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 86c3e25fa55b4719bdebf7397dea65d6 Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814324056-project Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '6be9d1a4-4d89-4006-93e6-fdbd8fb86765'} Jul 04 09:25:49.666762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. (HTTP 404) (Request-ID: req-55877864-036e-41aa-8745-14e106751f8c) Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:49.667744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:25:49.669206 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 09:25:49.670429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-91b5d9de-4927-4449-8fc8-6b5dadd2a09f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Returning 404 to user: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-91b5d9de-4927-4449-8fc8-6b5dadd2a09f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765" status: 404 len: 109 microversion: 2.1 time: 0.036072 Jul 04 09:25:49.671550 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 434/884] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:25:49 2022] GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:49.681564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-054475cf-3bd4-4e51-aebb-6ddacf96577f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7aaa4280>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:49.682669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-66136f15-6937-407f-8b11-82d011720ab2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:49.685714 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-66136f15-6937-407f-8b11-82d011720ab2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:49.692326 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-66136f15-6937-407f-8b11-82d011720ab2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:49.692778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-66136f15-6937-407f-8b11-82d011720ab2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:49.693578 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-66136f15-6937-407f-8b11-82d011720ab2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:49.694015 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-66136f15-6937-407f-8b11-82d011720ab2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:49.709070 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-054475cf-3bd4-4e51-aebb-6ddacf96577f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] HTTP exception thrown: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-054475cf-3bd4-4e51-aebb-6ddacf96577f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Request method failure captured: Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765 HTTP/1.1 Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrIW05NStqG_ev2FdYEX54HQfYf7Re5ePiAzsRtqOpyAYeiYeBJcA2IJ93Ip83hnG1PX0o2GlkHooG-j0-Z4_mUtEhDquGvoMrsoaIM9SBy8YYsIpIDpK_ideBJ1flA1X4qHrBg1WEO9XjwjSN4p2-9QQd1cCI4u9CINPlpLQnGUPKc Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 6df585d8538848e2a82604efefb49dc9 Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:25:49.711066 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_6df585d8538848e2a82604efefb49dc9", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 6df585d8538848e2a82604efefb49dc9 Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesSnapshotsTestJSON-1814324056-project Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 86c3e25fa55b4719bdebf7397dea65d6 Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814324056-project Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '6be9d1a4-4d89-4006-93e6-fdbd8fb86765'} Jul 04 09:25:49.712541 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. (HTTP 404) (Request-ID: req-7b3d419a-95c6-4782-b760-4966895a4b94) Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:49.716521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 09:25:49.718317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 09:25:49.719449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-054475cf-3bd4-4e51-aebb-6ddacf96577f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Returning 404 to user: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-054475cf-3bd4-4e51-aebb-6ddacf96577f tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765" status: 404 len: 109 microversion: 2.1 time: 0.034967 Jul 04 09:25:49.720564 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 451/885] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 4 09:25:49 2022] DELETE /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:49.722004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a1370685-cc24-4e38-92af-426305583fe1 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Calling method '.version_select at 0x7fad7aa93b80>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:49.750149 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-a1370685-cc24-4e38-92af-426305583fe1 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] HTTP exception thrown: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a1370685-cc24-4e38-92af-426305583fe1 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Request method failure captured: Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765 HTTP/1.1 Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrIW05NStqG_ev2FdYEX54HQfYf7Re5ePiAzsRtqOpyAYeiYeBJcA2IJ93Ip83hnG1PX0o2GlkHooG-j0-Z4_mUtEhDquGvoMrsoaIM9SBy8YYsIpIDpK_ideBJ1flA1X4qHrBg1WEO9XjwjSN4p2-9QQd1cCI4u9CINPlpLQnGUPKc Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 6df585d8538848e2a82604efefb49dc9 Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:25:49.752211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/6df585d8538848e2a82604efefb49dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_6df585d8538848e2a82604efefb49dc9", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 6df585d8538848e2a82604efefb49dc9 Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814324056 Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-VolumesSnapshotsTestJSON-1814324056-project Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 86c3e25fa55b4719bdebf7397dea65d6 Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814324056-project Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '6be9d1a4-4d89-4006-93e6-fdbd8fb86765'} Jul 04 09:25:49.753966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. (HTTP 404) (Request-ID: req-9ed49fa5-b6b6-45c7-a4e9-bad17061e401) Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:49.758083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 09:25:49.759717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 09:25:49.761236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a1370685-cc24-4e38-92af-426305583fe1 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] Returning 404 to user: Volume 6be9d1a4-4d89-4006-93e6-fdbd8fb86765 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a1370685-cc24-4e38-92af-426305583fe1 tempest-VolumesSnapshotsTestJSON-1814324056 tempest-VolumesSnapshotsTestJSON-1814324056-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765" status: 404 len: 109 microversion: 2.1 time: 0.036639 Jul 04 09:25:49.763618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 452/886] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:25:49 2022] GET /compute/v2.1/os-volumes/6be9d1a4-4d89-4006-93e6-fdbd8fb86765 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:25:49.831710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-66136f15-6937-407f-8b11-82d011720ab2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:49.839803 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-66136f15-6937-407f-8b11-82d011720ab2 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1673 microversion: 2.1 time: 0.160744 Jul 04 09:25:49.840753 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 435/887] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:49 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:25:50.414985 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7642362f-61c9-42cd-9cf6-9559022f8e32 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:50.415610 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7642362f-61c9-42cd-9cf6-9559022f8e32 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:50.421810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7642362f-61c9-42cd-9cf6-9559022f8e32 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:50.422268 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7642362f-61c9-42cd-9cf6-9559022f8e32 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:50.423055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7642362f-61c9-42cd-9cf6-9559022f8e32 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:50.423503 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7642362f-61c9-42cd-9cf6-9559022f8e32 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:50.562393 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7642362f-61c9-42cd-9cf6-9559022f8e32 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:50.570754 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7642362f-61c9-42cd-9cf6-9559022f8e32 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1679 microversion: 2.1 time: 0.160106 Jul 04 09:25:50.571325 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 453/888] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:50 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:50.859632 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-16ac776a-1def-43f8-87df-9bc2b4e0cd72 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:50.860246 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-16ac776a-1def-43f8-87df-9bc2b4e0cd72 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:50.867453 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-16ac776a-1def-43f8-87df-9bc2b4e0cd72 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:50.867905 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-16ac776a-1def-43f8-87df-9bc2b4e0cd72 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:50.868673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-16ac776a-1def-43f8-87df-9bc2b4e0cd72 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:50.869136 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-16ac776a-1def-43f8-87df-9bc2b4e0cd72 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:51.005956 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-16ac776a-1def-43f8-87df-9bc2b4e0cd72 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:51.013539 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-16ac776a-1def-43f8-87df-9bc2b4e0cd72 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1673 microversion: 2.1 time: 0.157813 Jul 04 09:25:51.014138 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 436/889] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:50 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:51.590315 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-41345372-c687-41a0-8a7c-126299b1d106 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:51.591600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-41345372-c687-41a0-8a7c-126299b1d106 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:51.599277 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41345372-c687-41a0-8a7c-126299b1d106 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:51.599993 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41345372-c687-41a0-8a7c-126299b1d106 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:51.600771 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41345372-c687-41a0-8a7c-126299b1d106 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:51.601235 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-41345372-c687-41a0-8a7c-126299b1d106 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:51.760036 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-41345372-c687-41a0-8a7c-126299b1d106 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:51.768623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-41345372-c687-41a0-8a7c-126299b1d106 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1679 microversion: 2.1 time: 0.182545 Jul 04 09:25:51.773249 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 454/890] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:51 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:52.031233 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-74791e9c-d58b-4da5-9148-cbf7dcae0fee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:52.032087 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-74791e9c-d58b-4da5-9148-cbf7dcae0fee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:52.039077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-74791e9c-d58b-4da5-9148-cbf7dcae0fee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:52.039839 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-74791e9c-d58b-4da5-9148-cbf7dcae0fee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:52.040811 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-74791e9c-d58b-4da5-9148-cbf7dcae0fee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:52.041395 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-74791e9c-d58b-4da5-9148-cbf7dcae0fee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:52.198653 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-74791e9c-d58b-4da5-9148-cbf7dcae0fee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:52.208544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-74791e9c-d58b-4da5-9148-cbf7dcae0fee tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1673 microversion: 2.1 time: 0.181467 Jul 04 09:25:52.209285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 437/891] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:52 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:52.787704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5cf4bda9-7d8f-43f4-922a-767b4f28b487 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:52.788429 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5cf4bda9-7d8f-43f4-922a-767b4f28b487 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:52.796366 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5cf4bda9-7d8f-43f4-922a-767b4f28b487 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:52.796942 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5cf4bda9-7d8f-43f4-922a-767b4f28b487 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:52.797860 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5cf4bda9-7d8f-43f4-922a-767b4f28b487 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:52.798397 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5cf4bda9-7d8f-43f4-922a-767b4f28b487 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:52.877111 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5cf4bda9-7d8f-43f4-922a-767b4f28b487 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:52.894074 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5cf4bda9-7d8f-43f4-922a-767b4f28b487 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1612 microversion: 2.1 time: 0.111164 Jul 04 09:25:52.905116 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 455/892] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:52 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1612 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:53.065650 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-cdc93379-4027-4fa5-aebe-dbbbadca1853 req-e5ee43dc-2fba-4747-95ee-a084d99c4139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf3ecbe-ac29-4c45-a385-f8fa5c699e5d", "name": "network-vif-deleted", "tag": "fd94d403-49cf-477b-9ae8-84dc8eff0d60"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:53.081774 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-cdc93379-4027-4fa5-aebe-dbbbadca1853 req-e5ee43dc-2fba-4747-95ee-a084d99c4139 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:53.083371 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-cdc93379-4027-4fa5-aebe-dbbbadca1853 req-e5ee43dc-2fba-4747-95ee-a084d99c4139 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:53.115272 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-cdc93379-4027-4fa5-aebe-dbbbadca1853 req-e5ee43dc-2fba-4747-95ee-a084d99c4139 service nova] Creating event network-vif-deleted:fd94d403-49cf-477b-9ae8-84dc8eff0d60 for instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d on hv-cinder-84456 Jul 04 09:25:53.126719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-cdc93379-4027-4fa5-aebe-dbbbadca1853 req-e5ee43dc-2fba-4747-95ee-a084d99c4139 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069712 Jul 04 09:25:53.130482 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 438/893] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:53.228171 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:53.228900 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:53.246641 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:53.247544 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:53.250421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:53.254976 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:53.314388 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:53.315858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:53.316736 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lazy-loading 'fault' on Instance uuid faf3ecbe-ac29-4c45-a385-f8fa5c699e5d {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:25:53.388581 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50f9b53a10a43fa9b5fec03d01f451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123c769553a1424e9c6dba4569bfaea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:53.402738 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e8788fd8-977f-443a-b07b-80e7a5d45262 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 200 len: 1327 microversion: 2.1 time: 0.179224 Jul 04 09:25:53.403815 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 456/894] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:53 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 1327 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:53.916517 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:53.918071 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:53.930598 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:53.935578 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:53.936561 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:53.938441 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:53.997028 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:54.001289 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:54.001826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:54.002904 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lazy-loading 'fault' on Instance uuid 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:25:54.058760 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc30b7d536444008e5b5bab45c5c438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba157b0e49f1447e82755035db8728d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:25:54.068298 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c4a6aadc-a588-4c41-a71a-df71adede415 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 200 len: 1330 microversion: 2.1 time: 0.155853 Jul 04 09:25:54.069373 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 439/895] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:53 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 1330 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:25:54.422071 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2eacd50a-ae99-4cb8-a47f-eaae48775b00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:54.422683 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2eacd50a-ae99-4cb8-a47f-eaae48775b00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:54.426850 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:25:54.432250 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2eacd50a-ae99-4cb8-a47f-eaae48775b00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:54.432530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2eacd50a-ae99-4cb8-a47f-eaae48775b00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:54.433336 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2eacd50a-ae99-4cb8-a47f-eaae48775b00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:54.433775 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2eacd50a-ae99-4cb8-a47f-eaae48775b00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:54.452842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-2eacd50a-ae99-4cb8-a47f-eaae48775b00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] HTTP exception thrown: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2eacd50a-ae99-4cb8-a47f-eaae48775b00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Request method failure captured: Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d HTTP/1.1 Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCYRK9LjDZcoDoRz5XL1cHZ_8sL5iREX6TakhIrZRmzJm3UYWltImN-VOTnlzeLRBQsTsbm3R_zXiioRnL1jkJip3sk69Xjcd4cDhDaSnnUCrqiQQW0v0uxSCSj6cz7foaUmrqJzQyjscNmsKW8Zr9NDCSk7kU6J0bq8UV7MU5ogPw Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:25:54.454516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_123c769553a1424e9c6dba4569bfaea5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: e50f9b53a10a43fa9b5fec03d01f451f Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:54.456988 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': 'faf3ecbe-ac29-4c45-a385-f8fa5c699e5d'} Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:54.457995 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:54.459526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:54.461540 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2eacd50a-ae99-4cb8-a47f-eaae48775b00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Returning 404 to user: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:54.461540 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2eacd50a-ae99-4cb8-a47f-eaae48775b00 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 404 len: 111 microversion: 2.1 time: 0.038507 Jul 04 09:25:54.461540 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 457/896] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:54 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:54.470629 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-843390a8-c865-422f-8603-ff18106f7959 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '.version_select at 0x7fad7aa67940>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:54.491999 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-843390a8-c865-422f-8603-ff18106f7959 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1674751112" status: 202 len: 0 microversion: 2.1 time: 0.026956 Jul 04 09:25:54.496171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 440/897] 10.222.0.71 () {58 vars in 1220 bytes} [Mon Jul 4 09:25:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1674751112 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:25:55.086870 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-47aef8e9-f02f-4255-a5f3-9fb11995c2dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:55.087637 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-47aef8e9-f02f-4255-a5f3-9fb11995c2dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:55.095771 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-47aef8e9-f02f-4255-a5f3-9fb11995c2dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:55.097617 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-47aef8e9-f02f-4255-a5f3-9fb11995c2dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:55.098639 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-47aef8e9-f02f-4255-a5f3-9fb11995c2dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:55.099210 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-47aef8e9-f02f-4255-a5f3-9fb11995c2dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:55.117413 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-47aef8e9-f02f-4255-a5f3-9fb11995c2dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-47aef8e9-f02f-4255-a5f3-9fb11995c2dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 HTTP/1.1 Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:25:55.119623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:55.121261 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '03ac9e1b-d4ff-4388-80ae-856b12ae84c5'} Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:55.122174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:55.123655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:55.125435 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-47aef8e9-f02f-4255-a5f3-9fb11995c2dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:55.125435 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-47aef8e9-f02f-4255-a5f3-9fb11995c2dc tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 404 len: 111 microversion: 2.1 time: 0.040852 Jul 04 09:25:55.129658 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 458/898] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:55 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:55.134496 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0d0c68c1-5043-4e73-bde7-d94203d451c5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '.version_select at 0x7fad7aab65e0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:55.154045 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0d0c68c1-5043-4e73-bde7-d94203d451c5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476296475" status: 202 len: 0 microversion: 2.1 time: 0.023393 Jul 04 09:25:55.154806 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 441/899] 10.222.0.71 () {58 vars in 1217 bytes} [Mon Jul 4 09:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476296475 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:25:55.251373 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-3916b1d2-038d-4f74-a0c6-d2b9c5b45509 req-b8109d4c-6d9c-49cd-8957-ab3d16c680e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ac9e1b-d4ff-4388-80ae-856b12ae84c5", "name": "network-vif-deleted", "tag": "ae0b093c-f317-43f2-bb12-0e0dc232b669"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:55.263088 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-3916b1d2-038d-4f74-a0c6-d2b9c5b45509 req-b8109d4c-6d9c-49cd-8957-ab3d16c680e7 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:55.263888 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-3916b1d2-038d-4f74-a0c6-d2b9c5b45509 req-b8109d4c-6d9c-49cd-8957-ab3d16c680e7 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:55.280339 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-3916b1d2-038d-4f74-a0c6-d2b9c5b45509 req-b8109d4c-6d9c-49cd-8957-ab3d16c680e7 service nova] Creating event network-vif-deleted:ae0b093c-f317-43f2-bb12-0e0dc232b669 for instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 on hv-cinder-84456 Jul 04 09:25:55.289322 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-3916b1d2-038d-4f74-a0c6-d2b9c5b45509 req-b8109d4c-6d9c-49cd-8957-ab3d16c680e7 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042227 Jul 04 09:25:55.291623 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 459/900] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:25:57.030610 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-066b930c-bee2-4662-9e3e-3e83fb3a22c2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:57.031117 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-066b930c-bee2-4662-9e3e-3e83fb3a22c2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:57.038619 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-066b930c-bee2-4662-9e3e-3e83fb3a22c2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:57.039073 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-066b930c-bee2-4662-9e3e-3e83fb3a22c2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:57.039836 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-066b930c-bee2-4662-9e3e-3e83fb3a22c2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:57.040279 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-066b930c-bee2-4662-9e3e-3e83fb3a22c2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:57.053230 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-066b930c-bee2-4662-9e3e-3e83fb3a22c2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-066b930c-bee2-4662-9e3e-3e83fb3a22c2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 HTTP/1.1 Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:25:57.054867 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:57.056476 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '03ac9e1b-d4ff-4388-80ae-856b12ae84c5'} Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:57.060318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:57.061791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.063227 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-066b930c-bee2-4662-9e3e-3e83fb3a22c2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:57.063227 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-066b930c-bee2-4662-9e3e-3e83fb3a22c2 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 404 len: 111 microversion: 2.1 time: 0.030011 Jul 04 09:25:57.063227 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 442/901] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:25:57 2022] DELETE /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:57.065814 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7dbe1f44-2d9c-4b2f-8a76-b7184efa75eb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:57.066555 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7dbe1f44-2d9c-4b2f-8a76-b7184efa75eb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 03ac9e1b-d4ff-4388-80ae-856b12ae84c5] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:57.072732 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7dbe1f44-2d9c-4b2f-8a76-b7184efa75eb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:57.073251 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7dbe1f44-2d9c-4b2f-8a76-b7184efa75eb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:57.074019 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7dbe1f44-2d9c-4b2f-8a76-b7184efa75eb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:57.074498 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7dbe1f44-2d9c-4b2f-8a76-b7184efa75eb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:57.087953 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-7dbe1f44-2d9c-4b2f-8a76-b7184efa75eb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7dbe1f44-2d9c-4b2f-8a76-b7184efa75eb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 HTTP/1.1 Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:25:57.089857 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:57.091492 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '03ac9e1b-d4ff-4388-80ae-856b12ae84c5'} Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:57.092364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. Jul 04 09:25:57.094090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.095413 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7dbe1f44-2d9c-4b2f-8a76-b7184efa75eb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 03ac9e1b-d4ff-4388-80ae-856b12ae84c5 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:57.095413 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7dbe1f44-2d9c-4b2f-8a76-b7184efa75eb tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5" status: 404 len: 111 microversion: 2.1 time: 0.030170 Jul 04 09:25:57.095413 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 460/902] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:57 2022] GET /compute/v2.1/servers/03ac9e1b-d4ff-4388-80ae-856b12ae84c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:57.743279 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ab6a8c66-ba79-452c-811d-0de0d5fc3d30 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:57.743771 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ab6a8c66-ba79-452c-811d-0de0d5fc3d30 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:57.749685 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab6a8c66-ba79-452c-811d-0de0d5fc3d30 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:57.750133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab6a8c66-ba79-452c-811d-0de0d5fc3d30 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:57.750885 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab6a8c66-ba79-452c-811d-0de0d5fc3d30 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:57.751317 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ab6a8c66-ba79-452c-811d-0de0d5fc3d30 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:57.764676 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-ab6a8c66-ba79-452c-811d-0de0d5fc3d30 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] HTTP exception thrown: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ab6a8c66-ba79-452c-811d-0de0d5fc3d30 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Request method failure captured: Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d HTTP/1.1 Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCYRK9LjDZcoDoRz5XL1cHZ_8sL5iREX6TakhIrZRmzJm3UYWltImN-VOTnlzeLRBQsTsbm3R_zXiioRnL1jkJip3sk69Xjcd4cDhDaSnnUCrqiQQW0v0uxSCSj6cz7foaUmrqJzQyjscNmsKW8Zr9NDCSk7kU6J0bq8UV7MU5ogPw Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:25:57.766204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_123c769553a1424e9c6dba4569bfaea5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: e50f9b53a10a43fa9b5fec03d01f451f Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:57.768254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'faf3ecbe-ac29-4c45-a385-f8fa5c699e5d'} Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:57.769162 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:57.770669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.772214 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ab6a8c66-ba79-452c-811d-0de0d5fc3d30 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Returning 404 to user: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:57.772214 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ab6a8c66-ba79-452c-811d-0de0d5fc3d30 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "DELETE /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 404 len: 111 microversion: 2.1 time: 0.028110 Jul 04 09:25:57.772634 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 443/903] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:25:57 2022] DELETE /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:57.777846 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a8f370dc-34ec-4588-b05f-358658f1c7b9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:25:57.778466 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a8f370dc-34ec-4588-b05f-358658f1c7b9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: faf3ecbe-ac29-4c45-a385-f8fa5c699e5d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:57.785081 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8f370dc-34ec-4588-b05f-358658f1c7b9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:57.785543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8f370dc-34ec-4588-b05f-358658f1c7b9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:57.786313 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8f370dc-34ec-4588-b05f-358658f1c7b9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:57.786753 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a8f370dc-34ec-4588-b05f-358658f1c7b9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:57.800488 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-a8f370dc-34ec-4588-b05f-358658f1c7b9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] HTTP exception thrown: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a8f370dc-34ec-4588-b05f-358658f1c7b9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Request method failure captured: Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d HTTP/1.1 Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCYRK9LjDZcoDoRz5XL1cHZ_8sL5iREX6TakhIrZRmzJm3UYWltImN-VOTnlzeLRBQsTsbm3R_zXiioRnL1jkJip3sk69Xjcd4cDhDaSnnUCrqiQQW0v0uxSCSj6cz7foaUmrqJzQyjscNmsKW8Zr9NDCSk7kU6J0bq8UV7MU5ogPw Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:25:57.802034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_123c769553a1424e9c6dba4569bfaea5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: e50f9b53a10a43fa9b5fec03d01f451f Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:57.803622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': 'faf3ecbe-ac29-4c45-a385-f8fa5c699e5d'} Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:25:57.804678 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. Jul 04 09:25:57.806164 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:25:57.807640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a8f370dc-34ec-4588-b05f-358658f1c7b9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Returning 404 to user: Instance faf3ecbe-ac29-4c45-a385-f8fa5c699e5d could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:25:57.807640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a8f370dc-34ec-4588-b05f-358658f1c7b9 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d" status: 404 len: 111 microversion: 2.1 time: 0.029381 Jul 04 09:25:57.807640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 461/904] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:25:57 2022] GET /compute/v2.1/servers/faf3ecbe-ac29-4c45-a385-f8fa5c699e5d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:25:59.887725 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fa6ea44d-ae8f-4481-a829-cbe488b7ea4e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-10137894"}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:25:59.888273 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fa6ea44d-ae8f-4481-a829-cbe488b7ea4e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:25:59.895605 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa6ea44d-ae8f-4481-a829-cbe488b7ea4e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:59.896062 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa6ea44d-ae8f-4481-a829-cbe488b7ea4e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:25:59.896829 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa6ea44d-ae8f-4481-a829-cbe488b7ea4e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:25:59.897305 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa6ea44d-ae8f-4481-a829-cbe488b7ea4e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:00.033140 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.network.security_group_api [None req-fa6ea44d-ae8f-4481-a829-cbe488b7ea4e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Removing security group 4218613c-a5b5-48f9-8c51-e48a7b43c071 from port ba329408-a9df-4565-8cdc-da224a105d5c Jul 04 09:26:00.322707 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-770861e3-4ffe-4511-9f7a-e5f817ff2bf1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:00.323232 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-770861e3-4ffe-4511-9f7a-e5f817ff2bf1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:00.329677 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-770861e3-4ffe-4511-9f7a-e5f817ff2bf1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:00.330643 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-770861e3-4ffe-4511-9f7a-e5f817ff2bf1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:00.331615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-770861e3-4ffe-4511-9f7a-e5f817ff2bf1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:00.332054 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-770861e3-4ffe-4511-9f7a-e5f817ff2bf1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:00.347987 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-770861e3-4ffe-4511-9f7a-e5f817ff2bf1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-770861e3-4ffe-4511-9f7a-e5f817ff2bf1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 HTTP/1.1 Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:26:00.349597 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:26:00.351215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '63068e8d-61aa-4db4-aa29-b3b179933ba9'} Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:00.355129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:26:00.357961 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.359263 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-770861e3-4ffe-4511-9f7a-e5f817ff2bf1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:00.359263 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-770861e3-4ffe-4511-9f7a-e5f817ff2bf1 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 404 len: 111 microversion: 2.1 time: 0.032128 Jul 04 09:26:00.359263 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 462/905] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:26:00 2022] DELETE /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:26:00.374252 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-346a5465-c59d-41b0-8425-5316b7b328d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:00.374885 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-346a5465-c59d-41b0-8425-5316b7b328d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 63068e8d-61aa-4db4-aa29-b3b179933ba9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:00.382368 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-346a5465-c59d-41b0-8425-5316b7b328d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:00.384166 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-346a5465-c59d-41b0-8425-5316b7b328d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:00.385154 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-346a5465-c59d-41b0-8425-5316b7b328d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:00.388308 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-346a5465-c59d-41b0-8425-5316b7b328d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:00.391958 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:00.410702 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fa6ea44d-ae8f-4481-a829-cbe488b7ea4e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "POST /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/action" status: 202 len: 0 microversion: 2.1 time: 0.526856 Jul 04 09:26:00.413217 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-346a5465-c59d-41b0-8425-5316b7b328d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:26:00.413847 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 444/906] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:25:59 2022] POST /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-346a5465-c59d-41b0-8425-5316b7b328d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 HTTP/1.1 Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:26:00.414858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:26:00.416272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '63068e8d-61aa-4db4-aa29-b3b179933ba9'} Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:00.421063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. Jul 04 09:26:00.422838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.425810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-346a5465-c59d-41b0-8425-5316b7b328d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 63068e8d-61aa-4db4-aa29-b3b179933ba9 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:00.425810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-346a5465-c59d-41b0-8425-5316b7b328d5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9" status: 404 len: 111 microversion: 2.1 time: 0.060666 Jul 04 09:26:00.425810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 463/907] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:00 2022] GET /compute/v2.1/servers/63068e8d-61aa-4db4-aa29-b3b179933ba9 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:26:00.438404 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0974dd86-3916-4b69-84c9-02ba353a3e2a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:00.439230 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0974dd86-3916-4b69-84c9-02ba353a3e2a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:00.461553 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0974dd86-3916-4b69-84c9-02ba353a3e2a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:00.462016 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0974dd86-3916-4b69-84c9-02ba353a3e2a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:00.462810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0974dd86-3916-4b69-84c9-02ba353a3e2a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:00.465163 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0974dd86-3916-4b69-84c9-02ba353a3e2a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:00.497855 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-0974dd86-3916-4b69-84c9-02ba353a3e2a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0974dd86-3916-4b69-84c9-02ba353a3e2a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e HTTP/1.1 Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:26:00.499453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:26:00.501462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e'} Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:00.502506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:26:00.504099 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.506328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0974dd86-3916-4b69-84c9-02ba353a3e2a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:00.507470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0974dd86-3916-4b69-84c9-02ba353a3e2a tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 404 len: 111 microversion: 2.1 time: 0.077331 Jul 04 09:26:00.516515 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 464/908] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:26:00 2022] DELETE /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:26:00.525716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0d181fb4-5301-4861-b7b4-c9ce381fb0b0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:00.529952 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0d181fb4-5301-4861-b7b4-c9ce381fb0b0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:00.544018 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0d181fb4-5301-4861-b7b4-c9ce381fb0b0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:00.544727 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0d181fb4-5301-4861-b7b4-c9ce381fb0b0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:00.545895 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0d181fb4-5301-4861-b7b4-c9ce381fb0b0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:00.547414 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0d181fb4-5301-4861-b7b4-c9ce381fb0b0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:00.567740 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-0d181fb4-5301-4861-b7b4-c9ce381fb0b0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0d181fb4-5301-4861-b7b4-c9ce381fb0b0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e HTTP/1.1 Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:26:00.570941 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:26:00.572537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e'} Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:00.573446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. Jul 04 09:26:00.574901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:00.580658 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0d181fb4-5301-4861-b7b4-c9ce381fb0b0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:00.581584 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0d181fb4-5301-4861-b7b4-c9ce381fb0b0 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e" status: 404 len: 111 microversion: 2.1 time: 0.059724 Jul 04 09:26:00.583848 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 465/909] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:00 2022] GET /compute/v2.1/servers/5a0ec839-0d15-4b1b-af3a-ef3d5304aa0e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:26:00.656758 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-d6fcee69-0587-4ebf-9a21-0e3bf4e6299f req-bf2dd20c-2078-4dfa-878d-fbceef419415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c288bc0-6da5-4db1-81a5-6a2122dcd793", "tag": "ba329408-a9df-4565-8cdc-da224a105d5c"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:26:00.667269 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-d6fcee69-0587-4ebf-9a21-0e3bf4e6299f req-bf2dd20c-2078-4dfa-878d-fbceef419415 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:00.667762 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-d6fcee69-0587-4ebf-9a21-0e3bf4e6299f req-bf2dd20c-2078-4dfa-878d-fbceef419415 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:00.697833 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-d6fcee69-0587-4ebf-9a21-0e3bf4e6299f req-bf2dd20c-2078-4dfa-878d-fbceef419415 service nova] Creating event network-changed:ba329408-a9df-4565-8cdc-da224a105d5c for instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 on hv-cinder-84456 Jul 04 09:26:00.703660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-d6fcee69-0587-4ebf-9a21-0e3bf4e6299f req-bf2dd20c-2078-4dfa-878d-fbceef419415 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275155 Jul 04 09:26:00.704440 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 445/910] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:01.056512 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d8e8cf5a-cd00-459e-945d-01df1eb61a38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:01.057513 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d8e8cf5a-cd00-459e-945d-01df1eb61a38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:01.067400 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d8e8cf5a-cd00-459e-945d-01df1eb61a38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.069630 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d8e8cf5a-cd00-459e-945d-01df1eb61a38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.070568 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d8e8cf5a-cd00-459e-945d-01df1eb61a38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.072212 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d8e8cf5a-cd00-459e-945d-01df1eb61a38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.100794 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-d8e8cf5a-cd00-459e-945d-01df1eb61a38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] HTTP exception thrown: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d8e8cf5a-cd00-459e-945d-01df1eb61a38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Request method failure captured: Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 HTTP/1.1 Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCYRK9LjDZcoDoRz5XL1cHZ_8sL5iREX6TakhIrZRmzJm3UYWltImN-VOTnlzeLRBQsTsbm3R_zXiioRnL1jkJip3sk69Xjcd4cDhDaSnnUCrqiQQW0v0uxSCSj6cz7foaUmrqJzQyjscNmsKW8Zr9NDCSk7kU6J0bq8UV7MU5ogPw Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:26:01.104057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_123c769553a1424e9c6dba4569bfaea5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: e50f9b53a10a43fa9b5fec03d01f451f Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:26:01.105711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '0f72ca5c-5b7b-4f0f-9e77-e3279a898c25'} Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:01.106598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:26:01.108055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.113765 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d8e8cf5a-cd00-459e-945d-01df1eb61a38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Returning 404 to user: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:01.115464 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d8e8cf5a-cd00-459e-945d-01df1eb61a38 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 404 len: 111 microversion: 2.1 time: 0.062921 Jul 04 09:26:01.116349 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 466/911] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:26:01 2022] DELETE /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:26:01.126545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-64bf5ea6-591e-4647-8404-16406b75cdd4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:01.128879 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-64bf5ea6-591e-4647-8404-16406b75cdd4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] [instance: 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:01.136525 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-64bf5ea6-591e-4647-8404-16406b75cdd4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.137297 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-64bf5ea6-591e-4647-8404-16406b75cdd4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.139175 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-64bf5ea6-591e-4647-8404-16406b75cdd4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.139625 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-64bf5ea6-591e-4647-8404-16406b75cdd4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.161020 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-64bf5ea6-591e-4647-8404-16406b75cdd4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] HTTP exception thrown: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-64bf5ea6-591e-4647-8404-16406b75cdd4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Request method failure captured: Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 HTTP/1.1 Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCYRK9LjDZcoDoRz5XL1cHZ_8sL5iREX6TakhIrZRmzJm3UYWltImN-VOTnlzeLRBQsTsbm3R_zXiioRnL1jkJip3sk69Xjcd4cDhDaSnnUCrqiQQW0v0uxSCSj6cz7foaUmrqJzQyjscNmsKW8Zr9NDCSk7kU6J0bq8UV7MU5ogPw Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:26:01.163018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/123c769553a1424e9c6dba4569bfaea5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_123c769553a1424e9c6dba4569bfaea5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 123c769553a1424e9c6dba4569bfaea5 Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82988425 Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: e50f9b53a10a43fa9b5fec03d01f451f Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeTestJSON-82988425-project Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:26:01.164766 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '0f72ca5c-5b7b-4f0f-9e77-e3279a898c25'} Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:01.165826 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. Jul 04 09:26:01.167336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.171954 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-64bf5ea6-591e-4647-8404-16406b75cdd4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] Returning 404 to user: Instance 0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:01.171954 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-64bf5ea6-591e-4647-8404-16406b75cdd4 tempest-AttachVolumeTestJSON-82988425 tempest-AttachVolumeTestJSON-82988425-project] 10.222.0.71 "GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25" status: 404 len: 111 microversion: 2.1 time: 0.047513 Jul 04 09:26:01.171954 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 446/912] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:01 2022] GET /compute/v2.1/servers/0f72ca5c-5b7b-4f0f-9e77-e3279a898c25 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:26:01.723087 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-77b7cdf7-5a56-48bf-ae5e-b85e4fff7303 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:01.724045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-77b7cdf7-5a56-48bf-ae5e-b85e4fff7303 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:01.730598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-77b7cdf7-5a56-48bf-ae5e-b85e4fff7303 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.731252 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-77b7cdf7-5a56-48bf-ae5e-b85e4fff7303 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.732196 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-77b7cdf7-5a56-48bf-ae5e-b85e4fff7303 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.732957 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-77b7cdf7-5a56-48bf-ae5e-b85e4fff7303 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.763595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-77b7cdf7-5a56-48bf-ae5e-b85e4fff7303 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045548 Jul 04 09:26:01.764770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 467/913] 10.222.0.71 () {60 vars in 1342 bytes} [Mon Jul 4 09:26:01 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:01.839742 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cecb73a1-7726-411a-a58c-6971c7ca1ac5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:01.840240 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cecb73a1-7726-411a-a58c-6971c7ca1ac5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:01.849627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cecb73a1-7726-411a-a58c-6971c7ca1ac5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.850098 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4f45a4d9-6604-495b-a623-d03b02e9bddd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:01.850665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4f45a4d9-6604-495b-a623-d03b02e9bddd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:01.851237 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cecb73a1-7726-411a-a58c-6971c7ca1ac5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.852242 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cecb73a1-7726-411a-a58c-6971c7ca1ac5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.852905 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cecb73a1-7726-411a-a58c-6971c7ca1ac5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.856887 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f45a4d9-6604-495b-a623-d03b02e9bddd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.857384 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f45a4d9-6604-495b-a623-d03b02e9bddd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.858155 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f45a4d9-6604-495b-a623-d03b02e9bddd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.858595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4f45a4d9-6604-495b-a623-d03b02e9bddd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.870230 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-cecb73a1-7726-411a-a58c-6971c7ca1ac5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cecb73a1-7726-411a-a58c-6971c7ca1ac5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b HTTP/1.1 Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:26:01.872421 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:26:01.873778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '1df7890f-b2e1-476d-a951-8ad28d7ff91b'} Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:01.874520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:26:01.875716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:01.879353 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cecb73a1-7726-411a-a58c-6971c7ca1ac5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:01.880824 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cecb73a1-7726-411a-a58c-6971c7ca1ac5 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "DELETE /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 404 len: 111 microversion: 2.1 time: 0.044543 Jul 04 09:26:01.885151 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 447/914] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:26:01 2022] DELETE /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:26:01.891777 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2780fa24-ef5c-447c-9649-c72973548bd7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:01.892889 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2780fa24-ef5c-447c-9649-c72973548bd7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:01.901540 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2780fa24-ef5c-447c-9649-c72973548bd7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.901993 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2780fa24-ef5c-447c-9649-c72973548bd7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.902764 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2780fa24-ef5c-447c-9649-c72973548bd7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:01.903685 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2780fa24-ef5c-447c-9649-c72973548bd7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:01.933404 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2780fa24-ef5c-447c-9649-c72973548bd7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:26:01.936380 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:01.960714 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-4f45a4d9-6604-495b-a623-d03b02e9bddd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lazy-loading 'services' on Instance uuid 0c288bc0-6da5-4db1-81a5-6a2122dcd793 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:26:02.043406 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2780fa24-ef5c-447c-9649-c72973548bd7 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "DELETE /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 204 len: 0 microversion: 2.20 time: 0.150637 Jul 04 09:26:02.044960 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 448/915] 10.222.0.71 () {60 vars in 1279 bytes} [Mon Jul 4 09:26:01 2022] DELETE /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 09:26:02.055424 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4f45a4d9-6604-495b-a623-d03b02e9bddd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments/7907b121-26b1-4d27-b760-02886b95249e" status: 202 len: 0 microversion: 2.1 time: 0.210230 Jul 04 09:26:02.056383 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 468/916] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:26:01 2022] DELETE /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments/7907b121-26b1-4d27-b760-02886b95249e => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:26:02.059357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c1e3f347-c5bd-4f1c-9b9d-6efcdaa5ff09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:02.060617 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c1e3f347-c5bd-4f1c-9b9d-6efcdaa5ff09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] [instance: 1df7890f-b2e1-476d-a951-8ad28d7ff91b] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:02.062233 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d5d0f6d1-dfba-419d-b5ed-68012ed3c8bc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:02.062982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d5d0f6d1-dfba-419d-b5ed-68012ed3c8bc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:02.069018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1e3f347-c5bd-4f1c-9b9d-6efcdaa5ff09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:02.069490 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1e3f347-c5bd-4f1c-9b9d-6efcdaa5ff09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:02.070577 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1e3f347-c5bd-4f1c-9b9d-6efcdaa5ff09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:02.071191 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1e3f347-c5bd-4f1c-9b9d-6efcdaa5ff09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:02.072148 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d5d0f6d1-dfba-419d-b5ed-68012ed3c8bc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:02.072659 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d5d0f6d1-dfba-419d-b5ed-68012ed3c8bc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:02.073466 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d5d0f6d1-dfba-419d-b5ed-68012ed3c8bc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:02.074081 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d5d0f6d1-dfba-419d-b5ed-68012ed3c8bc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:02.088072 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-c1e3f347-c5bd-4f1c-9b9d-6efcdaa5ff09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] HTTP exception thrown: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c1e3f347-c5bd-4f1c-9b9d-6efcdaa5ff09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Request method failure captured: Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b HTTP/1.1 Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCQAbTNTxhfNVWfF3EERJTtEwDbYtVcxid1khNJpIhj_1Cyp1J7f8NfBSWGxm4Bmj-SNp0VNXmrl9tlfVdPhZ5pLCESTOZjNcTqgvjtJndXcoAExckAqj4FPC6HUSDd7zDbgVIlIzP1o25uKjbc7aM7ZtV9f4nX77UgKeR5UOChjXQ Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:26:02.089751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/ba157b0e49f1447e82755035db8728d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_ba157b0e49f1447e82755035db8728d5", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: ba157b0e49f1447e82755035db8728d5 Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2033410134 Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 6bc30b7d536444008e5b5bab45c5c438 Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeNegativeTest-2033410134-project Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:26:02.091368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '1df7890f-b2e1-476d-a951-8ad28d7ff91b'} Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:02.092254 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. Jul 04 09:26:02.093992 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:02.096852 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c1e3f347-c5bd-4f1c-9b9d-6efcdaa5ff09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] Returning 404 to user: Instance 1df7890f-b2e1-476d-a951-8ad28d7ff91b could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:02.098061 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c1e3f347-c5bd-4f1c-9b9d-6efcdaa5ff09 tempest-AttachVolumeNegativeTest-2033410134 tempest-AttachVolumeNegativeTest-2033410134-project] 10.222.0.71 "GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b" status: 404 len: 111 microversion: 2.1 time: 0.051609 Jul 04 09:26:02.098774 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 449/917] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:02 2022] GET /compute/v2.1/servers/1df7890f-b2e1-476d-a951-8ad28d7ff91b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:26:02.104388 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c9d7e55e-05ec-4ebd-8869-16e78fe3a703 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:02.105354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c9d7e55e-05ec-4ebd-8869-16e78fe3a703 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:02.122056 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c9d7e55e-05ec-4ebd-8869-16e78fe3a703 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:02.122510 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c9d7e55e-05ec-4ebd-8869-16e78fe3a703 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:02.123297 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c9d7e55e-05ec-4ebd-8869-16e78fe3a703 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:02.123740 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c9d7e55e-05ec-4ebd-8869-16e78fe3a703 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:02.186510 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c9d7e55e-05ec-4ebd-8869-16e78fe3a703 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086497 Jul 04 09:26:02.188563 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 450/918] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:26:02 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:02.538326 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d5d0f6d1-dfba-419d-b5ed-68012ed3c8bc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:02.552131 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d5d0f6d1-dfba-419d-b5ed-68012ed3c8bc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:02.554662 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d5d0f6d1-dfba-419d-b5ed-68012ed3c8bc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:02.555981 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d5d0f6d1-dfba-419d-b5ed-68012ed3c8bc tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.498374 Jul 04 09:26:02.556787 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 469/919] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:02 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:02.722271 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-9cec0742-d102-4e84-b3ac-1e4837f8c124 req-6bfffc0e-50a0-4f6b-8c69-545f6d43bad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c288bc0-6da5-4db1-81a5-6a2122dcd793", "tag": "ba329408-a9df-4565-8cdc-da224a105d5c"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:26:02.733669 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-9cec0742-d102-4e84-b3ac-1e4837f8c124 req-6bfffc0e-50a0-4f6b-8c69-545f6d43bad5 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:02.734553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-9cec0742-d102-4e84-b3ac-1e4837f8c124 req-6bfffc0e-50a0-4f6b-8c69-545f6d43bad5 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:02.751611 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-9cec0742-d102-4e84-b3ac-1e4837f8c124 req-6bfffc0e-50a0-4f6b-8c69-545f6d43bad5 service nova] Creating event network-changed:ba329408-a9df-4565-8cdc-da224a105d5c for instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 on hv-cinder-84456 Jul 04 09:26:02.757571 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-9cec0742-d102-4e84-b3ac-1e4837f8c124 req-6bfffc0e-50a0-4f6b-8c69-545f6d43bad5 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039628 Jul 04 09:26:02.758563 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 451/920] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:03.199287 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1d9c437b-4cb4-4ebd-9e59-5a3daf2488c0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:03.201366 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1d9c437b-4cb4-4ebd-9e59-5a3daf2488c0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:03.222502 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d9c437b-4cb4-4ebd-9e59-5a3daf2488c0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:03.223158 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d9c437b-4cb4-4ebd-9e59-5a3daf2488c0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:03.224130 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d9c437b-4cb4-4ebd-9e59-5a3daf2488c0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:03.224730 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d9c437b-4cb4-4ebd-9e59-5a3daf2488c0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:03.291434 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1d9c437b-4cb4-4ebd-9e59-5a3daf2488c0 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096259 Jul 04 09:26:03.292018 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 470/921] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:26:03 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:03.575277 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ddee3745-091b-40c6-bc5d-93bea129fd01 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:03.576722 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ddee3745-091b-40c6-bc5d-93bea129fd01 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:03.584519 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ddee3745-091b-40c6-bc5d-93bea129fd01 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:03.594650 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ddee3745-091b-40c6-bc5d-93bea129fd01 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:03.595773 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ddee3745-091b-40c6-bc5d-93bea129fd01 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:03.596384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ddee3745-091b-40c6-bc5d-93bea129fd01 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:03.899139 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ddee3745-091b-40c6-bc5d-93bea129fd01 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:03.909928 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ddee3745-091b-40c6-bc5d-93bea129fd01 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:03.911988 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ddee3745-091b-40c6-bc5d-93bea129fd01 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:03.913446 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ddee3745-091b-40c6-bc5d-93bea129fd01 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.342501 Jul 04 09:26:03.914187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 452/922] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:03 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:04.304031 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6b9284f7-a5b8-47a5-a4e2-d10202db32c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:04.305348 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6b9284f7-a5b8-47a5-a4e2-d10202db32c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:04.324879 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6b9284f7-a5b8-47a5-a4e2-d10202db32c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:04.325606 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6b9284f7-a5b8-47a5-a4e2-d10202db32c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:04.331844 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6b9284f7-a5b8-47a5-a4e2-d10202db32c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:04.332274 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6b9284f7-a5b8-47a5-a4e2-d10202db32c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:04.417951 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6b9284f7-a5b8-47a5-a4e2-d10202db32c5 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117809 Jul 04 09:26:04.421863 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 471/923] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:26:04 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:04.933164 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e5766801-1d7f-40e8-80c3-0deb52597fcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:04.933780 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-e5766801-1d7f-40e8-80c3-0deb52597fcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:04.945427 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e5766801-1d7f-40e8-80c3-0deb52597fcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:04.945887 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e5766801-1d7f-40e8-80c3-0deb52597fcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:04.946704 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e5766801-1d7f-40e8-80c3-0deb52597fcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:04.947282 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-e5766801-1d7f-40e8-80c3-0deb52597fcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:05.340463 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e5766801-1d7f-40e8-80c3-0deb52597fcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:05.353107 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e5766801-1d7f-40e8-80c3-0deb52597fcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:05.354572 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-e5766801-1d7f-40e8-80c3-0deb52597fcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:05.355994 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e5766801-1d7f-40e8-80c3-0deb52597fcb tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.427532 Jul 04 09:26:05.356569 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 453/924] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:04 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:05.437073 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e4b0547f-38ef-4251-9f14-689b600dcb53 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:05.438592 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e4b0547f-38ef-4251-9f14-689b600dcb53 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:05.446703 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e4b0547f-38ef-4251-9f14-689b600dcb53 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:05.447289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e4b0547f-38ef-4251-9f14-689b600dcb53 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:05.448076 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e4b0547f-38ef-4251-9f14-689b600dcb53 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:05.448520 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e4b0547f-38ef-4251-9f14-689b600dcb53 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:05.541364 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e4b0547f-38ef-4251-9f14-689b600dcb53 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114701 Jul 04 09:26:05.545083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 472/925] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:26:05 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:06.377835 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-02ee86b1-afb2-4033-85b4-71f8b4413db5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:06.378734 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-02ee86b1-afb2-4033-85b4-71f8b4413db5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:06.389244 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02ee86b1-afb2-4033-85b4-71f8b4413db5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:06.392347 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02ee86b1-afb2-4033-85b4-71f8b4413db5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:06.395139 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02ee86b1-afb2-4033-85b4-71f8b4413db5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:06.395678 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-02ee86b1-afb2-4033-85b4-71f8b4413db5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:06.557268 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1d0a673e-3e60-43ef-81ac-3fd1dd2af3b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:06.558718 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1d0a673e-3e60-43ef-81ac-3fd1dd2af3b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:06.576820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d0a673e-3e60-43ef-81ac-3fd1dd2af3b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:06.579484 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d0a673e-3e60-43ef-81ac-3fd1dd2af3b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:06.583818 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d0a673e-3e60-43ef-81ac-3fd1dd2af3b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:06.584532 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1d0a673e-3e60-43ef-81ac-3fd1dd2af3b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:06.599107 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-02ee86b1-afb2-4033-85b4-71f8b4413db5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:06.612601 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-02ee86b1-afb2-4033-85b4-71f8b4413db5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:06.617148 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-02ee86b1-afb2-4033-85b4-71f8b4413db5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:06.621798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-02ee86b1-afb2-4033-85b4-71f8b4413db5 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1726 microversion: 2.20 time: 0.248286 Jul 04 09:26:06.622929 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 454/926] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:06 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1726 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:06.652845 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1d0a673e-3e60-43ef-81ac-3fd1dd2af3b1 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100489 Jul 04 09:26:06.654278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 473/927] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 4 09:26:06 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 09:26:06.664466 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d8952a5c-4407-4757-8876-5652ccad6fe2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:06.664971 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d8952a5c-4407-4757-8876-5652ccad6fe2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:06.673698 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d8952a5c-4407-4757-8876-5652ccad6fe2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:06.674672 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d8952a5c-4407-4757-8876-5652ccad6fe2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:06.676820 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d8952a5c-4407-4757-8876-5652ccad6fe2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:06.679695 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d8952a5c-4407-4757-8876-5652ccad6fe2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:06.788089 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-d8952a5c-4407-4757-8876-5652ccad6fe2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] HTTP exception thrown: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 is not attached to volume 7907b121-26b1-4d27-b760-02886b95249e Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d8952a5c-4407-4757-8876-5652ccad6fe2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Request method failure captured: Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments/7907b121-26b1-4d27-b760-02886b95249e HTTP/1.1 Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrGQuaz_bh8hNC-mIUvmxL8A30wmgCOHfNMUcqQ_r0qkycvn74XUq3a5obGu_orUhcmcEpfhsA8KoOp1DCz7Wx0trpspCurpsVZk42QLjI6I9jB319CfVhQUbhpWGNmCoxESi-ZYA0Ajr3WGAJyJ6TNqI802OQZ2RThJzUp7wEejpIo Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: c1411a14411442a1bded43af5f67decd Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestMinimumBasicScenario-1289018409 Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:26:06.797868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1411a14411442a1bded43af5f67decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1411a14411442a1bded43af5f67decd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c1411a14411442a1bded43af5f67decd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c1411a14411442a1bded43af5f67decd", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestMinimumBasicScenario-1289018409 Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: c1411a14411442a1bded43af5f67decd Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1289018409 Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-TestMinimumBasicScenario-1289018409-project Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: b5ed81725b574b01aba6c604fbf9ed50 Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestMinimumBasicScenario-1289018409-project Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:26:06.800147 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 is not attached to volume 7907b121-26b1-4d27-b760-02886b95249e Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'server_id': '0c288bc0-6da5-4db1-81a5-6a2122dcd793', 'id': '7907b121-26b1-4d27-b760-02886b95249e'} Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7907b121-26b1-4d27-b760-02886b95249e. Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:06.801093 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 is not attached to volume 7907b121-26b1-4d27-b760-02886b95249e Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 is not attached to volume 7907b121-26b1-4d27-b760-02886b95249e Jul 04 09:26:06.802627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:06.805423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d8952a5c-4407-4757-8876-5652ccad6fe2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Returning 404 to user: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 is not attached to volume 7907b121-26b1-4d27-b760-02886b95249e {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:06.806640 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d8952a5c-4407-4757-8876-5652ccad6fe2 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments/7907b121-26b1-4d27-b760-02886b95249e" status: 404 len: 154 microversion: 2.1 time: 0.146085 Jul 04 09:26:06.807731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 455/928] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 4 09:26:06 2022] DELETE /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793/os-volume_attachments/7907b121-26b1-4d27-b760-02886b95249e => generated 154 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:26:07.641181 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2945942d-e607-48af-946b-76f2a5b0997e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:07.642405 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2945942d-e607-48af-946b-76f2a5b0997e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:07.654114 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2945942d-e607-48af-946b-76f2a5b0997e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:07.656902 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2945942d-e607-48af-946b-76f2a5b0997e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:07.659275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2945942d-e607-48af-946b-76f2a5b0997e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:07.660589 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2945942d-e607-48af-946b-76f2a5b0997e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:07.763306 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-1cbaae09-91d5-4fed-a07f-d51c1a7bf650 req-2e31e6a5-6923-4784-aebf-bc22abcc0c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1af165-f9ff-409d-a80d-0998b4f545d9", "name": "network-vif-deleted", "tag": "a2d58751-fbe0-49d6-b04c-2629ea26d8f4"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:26:07.775813 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-1cbaae09-91d5-4fed-a07f-d51c1a7bf650 req-2e31e6a5-6923-4784-aebf-bc22abcc0c30 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:07.776385 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-1cbaae09-91d5-4fed-a07f-d51c1a7bf650 req-2e31e6a5-6923-4784-aebf-bc22abcc0c30 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:07.791071 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-1cbaae09-91d5-4fed-a07f-d51c1a7bf650 req-2e31e6a5-6923-4784-aebf-bc22abcc0c30 service nova] Creating event network-vif-deleted:a2d58751-fbe0-49d6-b04c-2629ea26d8f4 for instance fc1af165-f9ff-409d-a80d-0998b4f545d9 on hv-cinder-84456 Jul 04 09:26:07.802880 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-1cbaae09-91d5-4fed-a07f-d51c1a7bf650 req-2e31e6a5-6923-4784-aebf-bc22abcc0c30 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041527 Jul 04 09:26:07.804837 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 456/929] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:26:07.828914 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2945942d-e607-48af-946b-76f2a5b0997e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:07.838378 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2945942d-e607-48af-946b-76f2a5b0997e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:07.840217 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2945942d-e607-48af-946b-76f2a5b0997e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:07.842002 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2945942d-e607-48af-946b-76f2a5b0997e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1658 microversion: 2.20 time: 0.204874 Jul 04 09:26:07.842761 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 474/930] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:07 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1658 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:08.043447 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-dda30cbc-3b2e-425f-bc0f-6eb4ba18ce2e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:08.044190 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-dda30cbc-3b2e-425f-bc0f-6eb4ba18ce2e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:08.052294 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dda30cbc-3b2e-425f-bc0f-6eb4ba18ce2e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:08.052897 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dda30cbc-3b2e-425f-bc0f-6eb4ba18ce2e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:08.054354 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dda30cbc-3b2e-425f-bc0f-6eb4ba18ce2e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:08.054924 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dda30cbc-3b2e-425f-bc0f-6eb4ba18ce2e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:08.090868 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-dda30cbc-3b2e-425f-bc0f-6eb4ba18ce2e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:26:08.233628 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-dda30cbc-3b2e-425f-bc0f-6eb4ba18ce2e tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "DELETE /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 204 len: 0 microversion: 2.1 time: 0.195908 Jul 04 09:26:08.237180 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 457/931] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:26:08 2022] DELETE /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:26:08.245516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-15370875-2b7a-4617-afc4-a6b7796e7e73 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:08.248959 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-15370875-2b7a-4617-afc4-a6b7796e7e73 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:08.261171 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15370875-2b7a-4617-afc4-a6b7796e7e73 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:08.261636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15370875-2b7a-4617-afc4-a6b7796e7e73 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:08.262420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15370875-2b7a-4617-afc4-a6b7796e7e73 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:08.262865 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-15370875-2b7a-4617-afc4-a6b7796e7e73 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:08.442053 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-15370875-2b7a-4617-afc4-a6b7796e7e73 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:08.454792 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-15370875-2b7a-4617-afc4-a6b7796e7e73 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1554 microversion: 2.1 time: 0.213305 Jul 04 09:26:08.457266 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 475/932] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:08 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:26:08.863141 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-85f15dc6-da3c-45e9-88de-48dd0d835be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:08.864492 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-85f15dc6-da3c-45e9-88de-48dd0d835be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:08.873484 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85f15dc6-da3c-45e9-88de-48dd0d835be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:08.874130 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85f15dc6-da3c-45e9-88de-48dd0d835be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:08.875087 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85f15dc6-da3c-45e9-88de-48dd0d835be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:08.875526 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-85f15dc6-da3c-45e9-88de-48dd0d835be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:08.945291 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-85f15dc6-da3c-45e9-88de-48dd0d835be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:08.953753 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-85f15dc6-da3c-45e9-88de-48dd0d835be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:08.955406 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-85f15dc6-da3c-45e9-88de-48dd0d835be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:08.956554 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-85f15dc6-da3c-45e9-88de-48dd0d835be1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1367 microversion: 2.20 time: 0.098834 Jul 04 09:26:08.957454 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 458/933] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:08 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:09.474149 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-55891419-74fd-4557-a06a-fd198225e4ce tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:09.474766 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-55891419-74fd-4557-a06a-fd198225e4ce tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:09.481264 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-55891419-74fd-4557-a06a-fd198225e4ce tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:09.481748 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-55891419-74fd-4557-a06a-fd198225e4ce tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:09.482616 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-55891419-74fd-4557-a06a-fd198225e4ce tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:09.482947 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-55891419-74fd-4557-a06a-fd198225e4ce tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:09.620473 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-55891419-74fd-4557-a06a-fd198225e4ce tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:09.628132 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-55891419-74fd-4557-a06a-fd198225e4ce tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1554 microversion: 2.1 time: 0.159616 Jul 04 09:26:09.628712 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 476/934] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:09 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:09.975448 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8d04fade-ad4b-448f-a3ee-4993b7ad5b41 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:09.976160 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8d04fade-ad4b-448f-a3ee-4993b7ad5b41 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:09.982708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8d04fade-ad4b-448f-a3ee-4993b7ad5b41 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:09.983160 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8d04fade-ad4b-448f-a3ee-4993b7ad5b41 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:09.983927 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8d04fade-ad4b-448f-a3ee-4993b7ad5b41 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:09.984369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8d04fade-ad4b-448f-a3ee-4993b7ad5b41 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:10.047721 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8d04fade-ad4b-448f-a3ee-4993b7ad5b41 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:10.056310 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8d04fade-ad4b-448f-a3ee-4993b7ad5b41 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:10.057846 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8d04fade-ad4b-448f-a3ee-4993b7ad5b41 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:10.058981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8d04fade-ad4b-448f-a3ee-4993b7ad5b41 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1367 microversion: 2.20 time: 0.088144 Jul 04 09:26:10.059543 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 459/935] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:09 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:10.645613 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3a8dfd12-f47c-4840-a33d-32cd29f4d4cd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:10.646161 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3a8dfd12-f47c-4840-a33d-32cd29f4d4cd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:10.652902 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a8dfd12-f47c-4840-a33d-32cd29f4d4cd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:10.653404 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a8dfd12-f47c-4840-a33d-32cd29f4d4cd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:10.654179 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a8dfd12-f47c-4840-a33d-32cd29f4d4cd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:10.654624 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3a8dfd12-f47c-4840-a33d-32cd29f4d4cd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:10.789304 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3a8dfd12-f47c-4840-a33d-32cd29f4d4cd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:10.796681 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3a8dfd12-f47c-4840-a33d-32cd29f4d4cd tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1554 microversion: 2.1 time: 0.155762 Jul 04 09:26:10.797269 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 477/936] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:10 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:11.076338 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0ee690cc-00f0-48ef-8400-9559cf151d52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:11.076947 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0ee690cc-00f0-48ef-8400-9559cf151d52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:11.084131 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0ee690cc-00f0-48ef-8400-9559cf151d52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:11.084588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0ee690cc-00f0-48ef-8400-9559cf151d52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:11.085430 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0ee690cc-00f0-48ef-8400-9559cf151d52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:11.085879 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0ee690cc-00f0-48ef-8400-9559cf151d52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:11.158074 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0ee690cc-00f0-48ef-8400-9559cf151d52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:11.167218 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0ee690cc-00f0-48ef-8400-9559cf151d52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:11.168985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0ee690cc-00f0-48ef-8400-9559cf151d52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:11.170161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0ee690cc-00f0-48ef-8400-9559cf151d52 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1367 microversion: 2.20 time: 0.097741 Jul 04 09:26:11.170709 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 460/937] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:11 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:11.550521 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-49fc6f36-3638-4cfb-a5d1-e41b66d830b9 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7ab8c820>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:11.598711 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-49fc6f36-3638-4cfb-a5d1-e41b66d830b9 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/a94737a0-84be-4d75-b0d4-f1e1544e9f5d" status: 200 len: 351 microversion: 2.1 time: 0.052639 Jul 04 09:26:11.599287 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 478/938] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:26:11 2022] GET /compute/v2.1/os-volumes/a94737a0-84be-4d75-b0d4-f1e1544e9f5d => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:11.817939 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4ba1e501-506e-47e1-97d6-413da3f1bdab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:11.818568 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4ba1e501-506e-47e1-97d6-413da3f1bdab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:11.824883 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ba1e501-506e-47e1-97d6-413da3f1bdab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:11.825393 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ba1e501-506e-47e1-97d6-413da3f1bdab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:11.826207 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ba1e501-506e-47e1-97d6-413da3f1bdab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:11.826653 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ba1e501-506e-47e1-97d6-413da3f1bdab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:11.959470 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-4ba1e501-506e-47e1-97d6-413da3f1bdab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:11.966917 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4ba1e501-506e-47e1-97d6-413da3f1bdab tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1554 microversion: 2.1 time: 0.155965 Jul 04 09:26:11.967473 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 461/939] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:11 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:12.189388 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a72ace02-e7a8-4c48-ae59-90b18e48639a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:12.190598 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a72ace02-e7a8-4c48-ae59-90b18e48639a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:12.197384 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a72ace02-e7a8-4c48-ae59-90b18e48639a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:12.197842 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a72ace02-e7a8-4c48-ae59-90b18e48639a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:12.198615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a72ace02-e7a8-4c48-ae59-90b18e48639a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:12.199155 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a72ace02-e7a8-4c48-ae59-90b18e48639a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:12.269981 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a72ace02-e7a8-4c48-ae59-90b18e48639a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:12.287248 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a72ace02-e7a8-4c48-ae59-90b18e48639a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:12.290549 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a72ace02-e7a8-4c48-ae59-90b18e48639a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:12.291734 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a72ace02-e7a8-4c48-ae59-90b18e48639a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1367 microversion: 2.20 time: 0.107284 Jul 04 09:26:12.292283 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 479/940] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:12 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:12.984285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b2e71743-4774-4566-8f69-4d6544187caf tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:12.985026 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b2e71743-4774-4566-8f69-4d6544187caf tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:12.992725 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2e71743-4774-4566-8f69-4d6544187caf tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:12.993223 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2e71743-4774-4566-8f69-4d6544187caf tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:12.993980 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2e71743-4774-4566-8f69-4d6544187caf tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:12.994410 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b2e71743-4774-4566-8f69-4d6544187caf tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:13.119300 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b2e71743-4774-4566-8f69-4d6544187caf tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:13.126661 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b2e71743-4774-4566-8f69-4d6544187caf tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1554 microversion: 2.1 time: 0.146243 Jul 04 09:26:13.127280 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 462/941] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:12 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:13.309506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-12a264ea-9812-45ec-928e-f7a13d0fd304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:13.310113 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-12a264ea-9812-45ec-928e-f7a13d0fd304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:13.317365 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12a264ea-9812-45ec-928e-f7a13d0fd304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:13.317814 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12a264ea-9812-45ec-928e-f7a13d0fd304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:13.318573 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12a264ea-9812-45ec-928e-f7a13d0fd304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:13.319009 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-12a264ea-9812-45ec-928e-f7a13d0fd304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:13.381198 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-12a264ea-9812-45ec-928e-f7a13d0fd304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:13.389416 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-12a264ea-9812-45ec-928e-f7a13d0fd304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:13.390921 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-12a264ea-9812-45ec-928e-f7a13d0fd304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:13.392053 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-12a264ea-9812-45ec-928e-f7a13d0fd304 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1367 microversion: 2.20 time: 0.086414 Jul 04 09:26:13.392631 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 480/942] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:13 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:14.144382 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-769b2db9-b453-4529-ba2d-7651dd780155 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:14.145030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-769b2db9-b453-4529-ba2d-7651dd780155 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:14.151607 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-769b2db9-b453-4529-ba2d-7651dd780155 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:14.152066 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-769b2db9-b453-4529-ba2d-7651dd780155 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:14.152951 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-769b2db9-b453-4529-ba2d-7651dd780155 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:14.153334 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-769b2db9-b453-4529-ba2d-7651dd780155 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:14.299933 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-769b2db9-b453-4529-ba2d-7651dd780155 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:14.308006 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-769b2db9-b453-4529-ba2d-7651dd780155 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1554 microversion: 2.1 time: 0.168025 Jul 04 09:26:14.308701 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 463/943] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:14 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:14.410814 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:14.411431 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:14.418194 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:14.418676 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:14.419516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:14.420003 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:14.451588 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:14.452048 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:14.452507 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lazy-loading 'fault' on Instance uuid fc1af165-f9ff-409d-a80d-0998b4f545d9 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:26:14.499063 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:14.509631 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:14.511379 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60d06d081a29460b8e85b0b301399f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d33ddd4b124161aba270998b7d2462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:14.512966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d335a575-9149-439a-be2b-ff05f2bf6a27 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 200 len: 1372 microversion: 2.20 time: 0.106733 Jul 04 09:26:14.513647 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 481/944] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:14 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 09:26:15.029357 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8c3732a2-826a-4dd4-8a56-fea4b378405b tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7aa49c10>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:15.079340 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8c3732a2-826a-4dd4-8a56-fea4b378405b tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/3e13d8d3-b3af-45b0-a346-0e0fa7747ceb" status: 200 len: 351 microversion: 2.1 time: 0.053630 Jul 04 09:26:15.079915 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 464/945] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:26:15 2022] GET /compute/v2.1/os-volumes/3e13d8d3-b3af-45b0-a346-0e0fa7747ceb => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:15.334875 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d91c43b6-b22c-4c0c-a5cf-f5613afe03f6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:15.336003 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d91c43b6-b22c-4c0c-a5cf-f5613afe03f6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:15.351502 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d91c43b6-b22c-4c0c-a5cf-f5613afe03f6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:15.351975 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d91c43b6-b22c-4c0c-a5cf-f5613afe03f6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:15.365259 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d91c43b6-b22c-4c0c-a5cf-f5613afe03f6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:15.365259 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d91c43b6-b22c-4c0c-a5cf-f5613afe03f6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:15.400238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-b25a4fa5-7df0-4b9d-af48-07e67dd490ff req-8a0be7b6-d288-42c7-b2ab-c997e4aa6f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c288bc0-6da5-4db1-81a5-6a2122dcd793", "name": "network-vif-deleted", "tag": "ba329408-a9df-4565-8cdc-da224a105d5c"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:26:15.408570 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:15.410341 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-b25a4fa5-7df0-4b9d-af48-07e67dd490ff req-8a0be7b6-d288-42c7-b2ab-c997e4aa6f78 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:15.410973 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-b25a4fa5-7df0-4b9d-af48-07e67dd490ff req-8a0be7b6-d288-42c7-b2ab-c997e4aa6f78 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:15.422721 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:15.424903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-b25a4fa5-7df0-4b9d-af48-07e67dd490ff req-8a0be7b6-d288-42c7-b2ab-c997e4aa6f78 service nova] Creating event network-vif-deleted:ba329408-a9df-4565-8cdc-da224a105d5c for instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 on hv-cinder-84456 Jul 04 09:26:15.431210 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-b25a4fa5-7df0-4b9d-af48-07e67dd490ff req-8a0be7b6-d288-42c7-b2ab-c997e4aa6f78 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035890 Jul 04 09:26:15.432356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 465/946] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:26:15.468121 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d91c43b6-b22c-4c0c-a5cf-f5613afe03f6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:15.477712 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d91c43b6-b22c-4c0c-a5cf-f5613afe03f6 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1512 microversion: 2.1 time: 0.156124 Jul 04 09:26:15.478929 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 482/947] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:15 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:15.531656 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2edc2cae-4840-4843-95bc-76f65c3d4f2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:15.532436 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-2edc2cae-4840-4843-95bc-76f65c3d4f2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:15.540386 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2edc2cae-4840-4843-95bc-76f65c3d4f2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:15.540926 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2edc2cae-4840-4843-95bc-76f65c3d4f2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:15.541807 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2edc2cae-4840-4843-95bc-76f65c3d4f2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:15.542320 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-2edc2cae-4840-4843-95bc-76f65c3d4f2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:15.558293 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-2edc2cae-4840-4843-95bc-76f65c3d4f2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] HTTP exception thrown: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2edc2cae-4840-4843-95bc-76f65c3d4f2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Request method failure captured: Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 HTTP/1.1 Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCURe4wv-78P3gNJpGH87weBJlWBg3Ig9MzVuBXj6WW5IX9ko9achBNRIM6Gjn9W6c2uNBaq-kZkWmqYh9U_LeD2uF6LGdzRKdgkZpRcniYqSoRtBtrj2GWu1P6bWthexDX87zLjlHH8FGOtckrXrJIf137m1dl8wHCgcDQKevONKM Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:26:15.560133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_83d33ddd4b124161aba270998b7d2462", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 60d06d081a29460b8e85b0b301399f08 Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:15.561920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'fc1af165-f9ff-409d-a80d-0998b4f545d9'} Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:15.562872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:15.564408 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:15.566478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-2edc2cae-4840-4843-95bc-76f65c3d4f2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Returning 404 to user: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:15.566478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-2edc2cae-4840-4843-95bc-76f65c3d4f2a tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 404 len: 111 microversion: 2.20 time: 0.035761 Jul 04 09:26:15.566478 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 466/948] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:15 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:26:15.573333 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e19207b7-796d-483e-836e-892c5a4ead63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '.version_select at 0x7fad7a9b5f70>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:15.591955 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e19207b7-796d-483e-836e-892c5a4ead63 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552564425" status: 204 len: 0 microversion: 2.20 time: 0.022334 Jul 04 09:26:15.592530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 483/949] 10.222.0.71 () {60 vars in 1261 bytes} [Mon Jul 4 09:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552564425 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 04 09:26:16.495186 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c1ad7b86-9786-425a-93b6-29d841ccaa28 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:16.495796 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c1ad7b86-9786-425a-93b6-29d841ccaa28 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:16.502232 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1ad7b86-9786-425a-93b6-29d841ccaa28 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:16.502686 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1ad7b86-9786-425a-93b6-29d841ccaa28 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:16.504062 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1ad7b86-9786-425a-93b6-29d841ccaa28 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:16.504509 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c1ad7b86-9786-425a-93b6-29d841ccaa28 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:16.565394 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c1ad7b86-9786-425a-93b6-29d841ccaa28 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:16.573316 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c1ad7b86-9786-425a-93b6-29d841ccaa28 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1343 microversion: 2.1 time: 0.082178 Jul 04 09:26:16.573870 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 467/950] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:16 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1343 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:17.591303 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-2ba23c71-2037-4f1d-ad53-f49ec5903d2f tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:17.591846 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-2ba23c71-2037-4f1d-ad53-f49ec5903d2f tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:17.598852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2ba23c71-2037-4f1d-ad53-f49ec5903d2f tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:17.599309 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2ba23c71-2037-4f1d-ad53-f49ec5903d2f tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:17.600090 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2ba23c71-2037-4f1d-ad53-f49ec5903d2f tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:17.600539 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-2ba23c71-2037-4f1d-ad53-f49ec5903d2f tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:17.662352 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-2ba23c71-2037-4f1d-ad53-f49ec5903d2f tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5ed81725b574b01aba6c604fbf9ed50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1411a14411442a1bded43af5f67decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:26:17.669869 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-2ba23c71-2037-4f1d-ad53-f49ec5903d2f tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 200 len: 1343 microversion: 2.1 time: 0.083184 Jul 04 09:26:17.670435 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 484/951] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:17 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 1343 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:18.525266 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-249ee6cf-ae0d-461e-a608-585a3bf12a1e tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7a9cedc0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:18.577608 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-249ee6cf-ae0d-461e-a608-585a3bf12a1e tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/b2a6b118-45a2-4f26-9d07-552a4bb738df" status: 200 len: 351 microversion: 2.1 time: 0.056504 Jul 04 09:26:18.578222 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 468/952] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 4 09:26:18 2022] GET /compute/v2.1/os-volumes/b2a6b118-45a2-4f26-9d07-552a4bb738df => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:26:18.591817 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-93410dee-a779-46c5-a1f7-7a3326e71480 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7ab8ca60>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:18.674767 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-93410dee-a779-46c5-a1f7-7a3326e71480 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087291 Jul 04 09:26:18.675342 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 485/953] 10.222.0.71 () {58 vars in 1133 bytes} [Mon Jul 4 09:26:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:18.687097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ba5eefa4-121e-43e4-b141-4a0532c1e7ca tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:18.688376 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ba5eefa4-121e-43e4-b141-4a0532c1e7ca tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] [instance: 0c288bc0-6da5-4db1-81a5-6a2122dcd793] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:18.688752 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e1fab73b-0eba-4315-87a4-3c3e72fb7678 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7ab56b80>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:18.695547 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba5eefa4-121e-43e4-b141-4a0532c1e7ca tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:18.695999 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba5eefa4-121e-43e4-b141-4a0532c1e7ca tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:18.697059 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba5eefa4-121e-43e4-b141-4a0532c1e7ca tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:18.697512 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba5eefa4-121e-43e4-b141-4a0532c1e7ca tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:18.711018 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-ba5eefa4-121e-43e4-b141-4a0532c1e7ca tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] HTTP exception thrown: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 could not be found. Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ba5eefa4-121e-43e4-b141-4a0532c1e7ca tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Request method failure captured: Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 HTTP/1.1 Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrGQuaz_bh8hNC-mIUvmxL8A30wmgCOHfNMUcqQ_r0qkycvn74XUq3a5obGu_orUhcmcEpfhsA8KoOp1DCz7Wx0trpspCurpsVZk42QLjI6I9jB319CfVhQUbhpWGNmCoxESi-ZYA0Ajr3WGAJyJ6TNqI802OQZ2RThJzUp7wEejpIo Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: c1411a14411442a1bded43af5f67decd Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestMinimumBasicScenario-1289018409 Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:26:18.712548 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1411a14411442a1bded43af5f67decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1411a14411442a1bded43af5f67decd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c1411a14411442a1bded43af5f67decd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c1411a14411442a1bded43af5f67decd", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestMinimumBasicScenario-1289018409 Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: c1411a14411442a1bded43af5f67decd Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1289018409 Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-TestMinimumBasicScenario-1289018409-project Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: b5ed81725b574b01aba6c604fbf9ed50 Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestMinimumBasicScenario-1289018409-project Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 could not be found. Jul 04 09:26:18.714084 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '0c288bc0-6da5-4db1-81a5-6a2122dcd793'} Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 could not be found. Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:18.715036 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 could not be found. Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 could not be found. Jul 04 09:26:18.716429 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:18.717759 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ba5eefa4-121e-43e4-b141-4a0532c1e7ca tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Returning 404 to user: Instance 0c288bc0-6da5-4db1-81a5-6a2122dcd793 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:18.717759 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ba5eefa4-121e-43e4-b141-4a0532c1e7ca tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793" status: 404 len: 111 microversion: 2.1 time: 0.030798 Jul 04 09:26:18.717759 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 469/954] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:26:18 2022] GET /compute/v2.1/servers/0c288bc0-6da5-4db1-81a5-6a2122dcd793 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 09:26:18.722552 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c046ac5e-daf7-4a66-b894-0c28fc03b2d9 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] Calling method '.version_select at 0x7fad7a9ceaf0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:18.741111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c046ac5e-daf7-4a66-b894-0c28fc03b2d9 tempest-TestMinimumBasicScenario-1289018409 tempest-TestMinimumBasicScenario-1289018409-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-608818780" status: 202 len: 0 microversion: 2.1 time: 0.021921 Jul 04 09:26:18.741656 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 470/955] 10.222.0.71 () {58 vars in 1268 bytes} [Mon Jul 4 09:26:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-608818780 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:26:18.773411 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e1fab73b-0eba-4315-87a4-3c3e72fb7678 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088233 Jul 04 09:26:18.774069 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 486/956] 10.222.0.71 () {58 vars in 1148 bytes} [Mon Jul 4 09:26:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:26:18.786185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-3cbbce54-baba-4cff-a2db-895e5966ea40 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7aa10ee0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:18.869572 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-3cbbce54-baba-4cff-a2db-895e5966ea40 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087137 Jul 04 09:26:18.870343 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 471/957] 10.222.0.71 () {58 vars in 1133 bytes} [Mon Jul 4 09:26:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:18.881593 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4cc849d1-c27e-4673-9a9a-36224c6325fe tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7aba2160>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:18.962864 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4cc849d1-c27e-4673-9a9a-36224c6325fe tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085341 Jul 04 09:26:18.963443 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 487/958] 10.222.0.71 () {58 vars in 1166 bytes} [Mon Jul 4 09:26:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:18.975972 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-63f5230a-7e72-46e9-b762-fb8b49991f4d tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7a9e7ee0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:19.063115 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-63f5230a-7e72-46e9-b762-fb8b49991f4d tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091485 Jul 04 09:26:19.063680 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 472/959] 10.222.0.71 () {58 vars in 1169 bytes} [Mon Jul 4 09:26:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:19.075437 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0ff6061c-3bc8-4c0a-8a8c-0adca75c3442 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7aaab9d0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:19.164422 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0ff6061c-3bc8-4c0a-8a8c-0adca75c3442 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.092734 Jul 04 09:26:19.165186 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 488/960] 10.222.0.71 () {58 vars in 1154 bytes} [Mon Jul 4 09:26:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:26:19.176290 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-e47807a8-0602-4d46-91ff-ceb2d7cc0fee tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7a9ceee0>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:19.263696 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-e47807a8-0602-4d46-91ff-ceb2d7cc0fee tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091060 Jul 04 09:26:19.264106 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 473/961] 10.222.0.71 () {58 vars in 1187 bytes} [Mon Jul 4 09:26:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:26:19.277516 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ec5629e7-74e9-4edf-94ad-c1debc324c92 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] Calling method '.version_select at 0x7fad7aaf7550>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:19.373370 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ec5629e7-74e9-4edf-94ad-c1debc324c92 tempest-VolumesTestJSON-723763091 tempest-VolumesTestJSON-723763091-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.099403 Jul 04 09:26:19.375737 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 489/962] 10.222.0.71 () {58 vars in 1154 bytes} [Mon Jul 4 09:26:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:26:19.633016 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fa019bdc-a2b8-4d6e-bf0d-12637fb78975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:19.634522 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fa019bdc-a2b8-4d6e-bf0d-12637fb78975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:19.646310 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa019bdc-a2b8-4d6e-bf0d-12637fb78975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:19.647149 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa019bdc-a2b8-4d6e-bf0d-12637fb78975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:19.647917 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa019bdc-a2b8-4d6e-bf0d-12637fb78975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:19.648617 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fa019bdc-a2b8-4d6e-bf0d-12637fb78975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:19.668519 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-fa019bdc-a2b8-4d6e-bf0d-12637fb78975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] HTTP exception thrown: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fa019bdc-a2b8-4d6e-bf0d-12637fb78975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Request method failure captured: Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 HTTP/1.1 Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCURe4wv-78P3gNJpGH87weBJlWBg3Ig9MzVuBXj6WW5IX9ko9achBNRIM6Gjn9W6c2uNBaq-kZkWmqYh9U_LeD2uF6LGdzRKdgkZpRcniYqSoRtBtrj2GWu1P6bWthexDX87zLjlHH8FGOtckrXrJIf137m1dl8wHCgcDQKevONKM Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:26:19.670590 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_83d33ddd4b124161aba270998b7d2462", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 60d06d081a29460b8e85b0b301399f08 Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:19.672174 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'fc1af165-f9ff-409d-a80d-0998b4f545d9'} Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:19.673097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:19.674555 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:19.676513 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fa019bdc-a2b8-4d6e-bf0d-12637fb78975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Returning 404 to user: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:19.678616 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fa019bdc-a2b8-4d6e-bf0d-12637fb78975 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "DELETE /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 404 len: 111 microversion: 2.20 time: 0.054389 Jul 04 09:26:19.679290 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 474/963] 10.222.0.71 () {60 vars in 1279 bytes} [Mon Jul 4 09:26:19 2022] DELETE /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:26:19.688127 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d9291104-24fb-4f6b-9735-09291c814ee1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:19.688740 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d9291104-24fb-4f6b-9735-09291c814ee1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: fc1af165-f9ff-409d-a80d-0998b4f545d9] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:19.696393 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9291104-24fb-4f6b-9735-09291c814ee1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:19.696848 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9291104-24fb-4f6b-9735-09291c814ee1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:19.697666 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9291104-24fb-4f6b-9735-09291c814ee1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:19.698109 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d9291104-24fb-4f6b-9735-09291c814ee1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:19.714838 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-d9291104-24fb-4f6b-9735-09291c814ee1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] HTTP exception thrown: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d9291104-24fb-4f6b-9735-09291c814ee1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Request method failure captured: Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 HTTP/1.1 Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCURe4wv-78P3gNJpGH87weBJlWBg3Ig9MzVuBXj6WW5IX9ko9achBNRIM6Gjn9W6c2uNBaq-kZkWmqYh9U_LeD2uF6LGdzRKdgkZpRcniYqSoRtBtrj2GWu1P6bWthexDX87zLjlHH8FGOtckrXrJIf137m1dl8wHCgcDQKevONKM Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:26:19.716785 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_83d33ddd4b124161aba270998b7d2462", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 60d06d081a29460b8e85b0b301399f08 Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:19.718278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': 'fc1af165-f9ff-409d-a80d-0998b4f545d9'} Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:19.719289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. Jul 04 09:26:19.720600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:19.723309 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d9291104-24fb-4f6b-9735-09291c814ee1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Returning 404 to user: Instance fc1af165-f9ff-409d-a80d-0998b4f545d9 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:19.724788 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d9291104-24fb-4f6b-9735-09291c814ee1 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9" status: 404 len: 111 microversion: 2.20 time: 0.040632 Jul 04 09:26:19.726123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 490/964] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:19 2022] GET /compute/v2.1/servers/fc1af165-f9ff-409d-a80d-0998b4f545d9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:26:24.048680 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-575b3fc1-eaf1-410d-b286-ddd448e23293 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:24.049289 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-575b3fc1-eaf1-410d-b286-ddd448e23293 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:24.051975 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:26:24.058388 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-575b3fc1-eaf1-410d-b286-ddd448e23293 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:24.058848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-575b3fc1-eaf1-410d-b286-ddd448e23293 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:24.059849 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-575b3fc1-eaf1-410d-b286-ddd448e23293 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:24.060509 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-575b3fc1-eaf1-410d-b286-ddd448e23293 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:24.085804 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-575b3fc1-eaf1-410d-b286-ddd448e23293 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] HTTP exception thrown: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-575b3fc1-eaf1-410d-b286-ddd448e23293 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Request method failure captured: Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: DELETE /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 HTTP/1.1 Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrCURe4wv-78P3gNJpGH87weBJlWBg3Ig9MzVuBXj6WW5IX9ko9achBNRIM6Gjn9W6c2uNBaq-kZkWmqYh9U_LeD2uF6LGdzRKdgkZpRcniYqSoRtBtrj2GWu1P6bWthexDX87zLjlHH8FGOtckrXrJIf137m1dl8wHCgcDQKevONKM Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:26:24.088146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_83d33ddd4b124161aba270998b7d2462", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 60d06d081a29460b8e85b0b301399f08 Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:26:24.089666 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '9a8dcc08-23ef-46ee-b941-55a7f1716d41'} Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:24.090471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:26:24.091834 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:26:24.094689 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-575b3fc1-eaf1-410d-b286-ddd448e23293 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Returning 404 to user: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:24.095704 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-575b3fc1-eaf1-410d-b286-ddd448e23293 tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "DELETE /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 404 len: 111 microversion: 2.20 time: 0.050981 Jul 04 09:26:24.096726 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 475/965] 10.222.0.71 () {60 vars in 1279 bytes} [Mon Jul 4 09:26:24 2022] DELETE /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 09:26:24.105328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-36002df1-6713-4676-a2c8-aa1736e7e45e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:26:24.105979 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-36002df1-6713-4676-a2c8-aa1736e7e45e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] [instance: 9a8dcc08-23ef-46ee-b941-55a7f1716d41] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:26:24.116468 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36002df1-6713-4676-a2c8-aa1736e7e45e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:24.116944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36002df1-6713-4676-a2c8-aa1736e7e45e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:24.125820 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36002df1-6713-4676-a2c8-aa1736e7e45e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:26:24.126688 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-36002df1-6713-4676-a2c8-aa1736e7e45e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:26:24.147194 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-36002df1-6713-4676-a2c8-aa1736e7e45e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] HTTP exception thrown: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-36002df1-6713-4676-a2c8-aa1736e7e45e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Request method failure captured: Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 HTTP/1.1 Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrCURe4wv-78P3gNJpGH87weBJlWBg3Ig9MzVuBXj6WW5IX9ko9achBNRIM6Gjn9W6c2uNBaq-kZkWmqYh9U_LeD2uF6LGdzRKdgkZpRcniYqSoRtBtrj2GWu1P6bWthexDX87zLjlHH8FGOtckrXrJIf137m1dl8wHCgcDQKevONKM Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:26:24.149530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/83d33ddd4b124161aba270998b7d2462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_83d33ddd4b124161aba270998b7d2462", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 83d33ddd4b124161aba270998b7d2462 Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1767378343 Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 60d06d081a29460b8e85b0b301399f08 Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1767378343-project Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:26:24.151141 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': '9a8dcc08-23ef-46ee-b941-55a7f1716d41'} Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:26:24.151892 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. Jul 04 09:26:24.153207 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:26:24.155922 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-36002df1-6713-4676-a2c8-aa1736e7e45e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] Returning 404 to user: Instance 9a8dcc08-23ef-46ee-b941-55a7f1716d41 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:26:24.157538 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-36002df1-6713-4676-a2c8-aa1736e7e45e tempest-AttachVolumeShelveTestJSON-1767378343 tempest-AttachVolumeShelveTestJSON-1767378343-project] 10.222.0.71 "GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41" status: 404 len: 111 microversion: 2.20 time: 0.056301 Jul 04 09:26:24.158685 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 491/966] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 4 09:26:24 2022] GET /compute/v2.1/servers/9a8dcc08-23ef-46ee-b941-55a7f1716d41 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 04 09:27:31.930931 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=15 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:32.118791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-316d14c9-781d-4534-b52c-1eea17bb6f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Action: 'create', calling method: .version_select at 0x7fad7aa109d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-768617593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcfhEp3/THx+julfjnXDTBvG4ayVcvrozgPpEc23F8Q9vlCPyITVCkKrTIPafJybgXHbQkUMybn8KBsek/lN0WhUuWuCSRhyr64yjuhd4y6z79r+YLAEitGdmi9JsXyUg=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:32.132934 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-316d14c9-781d-4534-b52c-1eea17bb6f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Getting quotas for project a2b9fbff141540f0858c09f7ea1e80b9. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:27:32.136814 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-316d14c9-781d-4534-b52c-1eea17bb6f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Getting quotas for user df06c3b8aef249b984bc907b1753747c and project a2b9fbff141540f0858c09f7ea1e80b9. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:27:32.168685 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-316d14c9-781d-4534-b52c-1eea17bb6f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.239656 Jul 04 09:27:32.169248 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 476/967] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 4 09:27:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:44.040781 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:27:44.041350 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Mon Jul 4 09:27:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:27:44.255605 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:44.257214 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=13 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:44.262453 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2081393645", "imageRef": "2fa57077-e8de-400f-9178-187f83f985e9", "flavorRef": "452"}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:44.593783 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:27:44.594573 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Mon Jul 4 09:27:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:27:44.781704 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR oslo.messaging._drivers.impl_rabbit [-] [61b79f91-f7e6-4849-b384-57ea0acab081] AMQP server on 10.222.0.71:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 04 09:27:45.793340 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] [61b79f91-f7e6-4849-b384-57ea0acab081] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 57594. Jul 04 09:27:47.041107 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=4 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:47.042344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:27:47.206300 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] validate_networks() for None {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:27:47.337156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-66ecfff8-51ca-4521-ae67-3f4b94e125a1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Action: 'create', calling method: .version_select at 0x7fad7aa5ff70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1745159673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/cC2s/l+w1/ugrahTUvuA9oRp8mxjzwmSnLPN/gCBPSYJP8VXrGsTdQdxaogQG7CytpXQjnxE6vQzNt2Xdy/t1p1KEI2JU/aSKl8MYfV+xO2t6fDZJbGoVyJgQuXfTAg=="}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:47.376051 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-66ecfff8-51ca-4521-ae67-3f4b94e125a1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Getting quotas for project 4fe236d825ae40f793bf2a5bccedc3cd. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:27:47.408724 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-66ecfff8-51ca-4521-ae67-3f4b94e125a1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Getting quotas for user 70733d7f6b8b42a39425ebc94e1ec1f4 and project 4fe236d825ae40f793bf2a5bccedc3cd. Resources: {'key_pairs'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:27:47.454871 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-66ecfff8-51ca-4521-ae67-3f4b94e125a1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.420969 Jul 04 09:27:47.455793 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 477/968] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 4 09:27:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:47.624657 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:27:47.625108 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:27:47.625909 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:27:47.626582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:27:47.627286 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:27:47.641587 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:47.642043 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:47.643396 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:47.644034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:47.667493 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Getting quotas for project 21ffc237d7f243dc9d0efe8a367b5077. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:27:47.673242 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Getting quotas for user 21b2f682cc1847a180eafa93f9d90d35 and project 21ffc237d7f243dc9d0efe8a367b5077. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:27:47.689494 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:27:47.692506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2fa57077-e8de-400f-9178-187f83f985e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:27:47.785028 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-412a0759-9ff3-460a-836c-08e5abb24991 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.528361 Jul 04 09:27:47.789215 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 492/969] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:27:47.797366 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f2c23265-9218-4d8a-b637-cb5b77cfe395 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:47.798152 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f2c23265-9218-4d8a-b637-cb5b77cfe395 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:47.901407 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f2c23265-9218-4d8a-b637-cb5b77cfe395 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:47.914690 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f2c23265-9218-4d8a-b637-cb5b77cfe395 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1215 microversion: 2.1 time: 0.120416 Jul 04 09:27:47.917032 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 478/970] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:47 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:48.938009 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1c9e5764-9b29-4d1d-9fb7-a9ed7f5996b2 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:48.941369 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1c9e5764-9b29-4d1d-9fb7-a9ed7f5996b2 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:48.951538 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1c9e5764-9b29-4d1d-9fb7-a9ed7f5996b2 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:48.951997 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1c9e5764-9b29-4d1d-9fb7-a9ed7f5996b2 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:48.952778 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1c9e5764-9b29-4d1d-9fb7-a9ed7f5996b2 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:48.953444 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1c9e5764-9b29-4d1d-9fb7-a9ed7f5996b2 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:49.084504 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-1c9e5764-9b29-4d1d-9fb7-a9ed7f5996b2 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:49.095846 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1c9e5764-9b29-4d1d-9fb7-a9ed7f5996b2 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1275 microversion: 2.1 time: 0.162694 Jul 04 09:27:49.096434 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 493/971] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:48 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:50.117103 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-58933a40-1c50-44c3-87f3-5d026fffced1 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:50.117954 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-58933a40-1c50-44c3-87f3-5d026fffced1 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:50.134409 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58933a40-1c50-44c3-87f3-5d026fffced1 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:50.135133 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58933a40-1c50-44c3-87f3-5d026fffced1 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:50.136169 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58933a40-1c50-44c3-87f3-5d026fffced1 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:50.136620 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-58933a40-1c50-44c3-87f3-5d026fffced1 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:50.371291 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-58933a40-1c50-44c3-87f3-5d026fffced1 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:50.387497 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-58933a40-1c50-44c3-87f3-5d026fffced1 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1315 microversion: 2.1 time: 0.276091 Jul 04 09:27:50.388090 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 479/972] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:50 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:51.230395 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-b65b32bd-088a-4253-9e40-2a5435d751e2 req-883a4192-894a-4afe-982e-fa9cf71e4ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2", "tag": "225c986c-78e4-47a5-a37e-1e7a08ee8b0b"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:51.240998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-b65b32bd-088a-4253-9e40-2a5435d751e2 req-883a4192-894a-4afe-982e-fa9cf71e4ed0 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:51.241534 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-b65b32bd-088a-4253-9e40-2a5435d751e2 req-883a4192-894a-4afe-982e-fa9cf71e4ed0 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:51.273240 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-b65b32bd-088a-4253-9e40-2a5435d751e2 req-883a4192-894a-4afe-982e-fa9cf71e4ed0 service nova] Creating event network-changed:225c986c-78e4-47a5-a37e-1e7a08ee8b0b for instance af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 on hv-cinder-84456 Jul 04 09:27:51.278630 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-b65b32bd-088a-4253-9e40-2a5435d751e2 req-883a4192-894a-4afe-982e-fa9cf71e4ed0 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052257 Jul 04 09:27:51.280181 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 494/973] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:51.415563 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-43a42122-76f5-4b33-be45-b0ab43a77f3c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:51.417847 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-43a42122-76f5-4b33-be45-b0ab43a77f3c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:51.428970 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43a42122-76f5-4b33-be45-b0ab43a77f3c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:51.429472 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43a42122-76f5-4b33-be45-b0ab43a77f3c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:51.430263 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43a42122-76f5-4b33-be45-b0ab43a77f3c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:51.430706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-43a42122-76f5-4b33-be45-b0ab43a77f3c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:51.695077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-43a42122-76f5-4b33-be45-b0ab43a77f3c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:51.704332 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-43a42122-76f5-4b33-be45-b0ab43a77f3c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1315 microversion: 2.1 time: 0.293575 Jul 04 09:27:51.706275 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 480/974] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:51 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:27:52.278600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-312838709", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-768617593", "security_groups": [{"name": "tempest-secgroup-smoke-2013560263"}], "networks": [{"uuid": "f05eda01-d077-43d3-a8e2-ee860ceab8b4"}], "block_device_mapping_v2": [{"uuid": "c1e6b51f-3528-47d5-81fa-5166990c615c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:52.398130 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] validate_networks() for [('f05eda01-d077-43d3-a8e2-ee860ceab8b4', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:27:52.722595 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-50925b88-addb-4928-8055-ec5c45955f46 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:52.723431 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-50925b88-addb-4928-8055-ec5c45955f46 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:52.730171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50925b88-addb-4928-8055-ec5c45955f46 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:52.730616 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50925b88-addb-4928-8055-ec5c45955f46 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:52.731509 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50925b88-addb-4928-8055-ec5c45955f46 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:52.731949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-50925b88-addb-4928-8055-ec5c45955f46 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:52.983396 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-50925b88-addb-4928-8055-ec5c45955f46 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:52.987252 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:27:52.988034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:27:52.988512 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:27:52.988930 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:27:52.989400 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:27:52.992325 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-50925b88-addb-4928-8055-ec5c45955f46 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1315 microversion: 2.1 time: 0.273738 Jul 04 09:27:52.992921 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 481/975] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:52 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:27:53.000401 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:53.000782 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:53.001840 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:53.002409 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:53.020777 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Getting quotas for project a2b9fbff141540f0858c09f7ea1e80b9. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:27:53.026208 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Getting quotas for user df06c3b8aef249b984bc907b1753747c and project a2b9fbff141540f0858c09f7ea1e80b9. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:27:53.092284 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:27:53.095083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1e6b51f-3528-47d5-81fa-5166990c615c',volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:27:53.255037 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-394026d2-1f7f-4aca-88fd-5ec9c845d99b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.980908 Jul 04 09:27:53.261161 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 495/976] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:27:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:27:53.283718 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d0964e5f-ab2a-474c-9e53-06eb00492a3e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:53.284848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d0964e5f-ab2a-474c-9e53-06eb00492a3e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:53.350202 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d0964e5f-ab2a-474c-9e53-06eb00492a3e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:53.359409 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d0964e5f-ab2a-474c-9e53-06eb00492a3e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1087 microversion: 2.1 time: 0.081141 Jul 04 09:27:53.369621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 482/977] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:53 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1087 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:54.011069 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f5e8b530-920b-457f-a184-d63871a1e81a tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:54.011697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f5e8b530-920b-457f-a184-d63871a1e81a tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:54.018798 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5e8b530-920b-457f-a184-d63871a1e81a tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:54.019246 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5e8b530-920b-457f-a184-d63871a1e81a tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:54.020045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5e8b530-920b-457f-a184-d63871a1e81a tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:54.020462 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f5e8b530-920b-457f-a184-d63871a1e81a tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:54.155123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f5e8b530-920b-457f-a184-d63871a1e81a tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:54.163700 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f5e8b530-920b-457f-a184-d63871a1e81a tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1315 microversion: 2.1 time: 0.158187 Jul 04 09:27:54.170888 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 496/978] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:54 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:54.377719 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-077fd8b5-5405-4f4a-9895-d50718b98a1d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:54.378332 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-077fd8b5-5405-4f4a-9895-d50718b98a1d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:54.393754 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-077fd8b5-5405-4f4a-9895-d50718b98a1d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:54.396734 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-077fd8b5-5405-4f4a-9895-d50718b98a1d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:54.397982 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-077fd8b5-5405-4f4a-9895-d50718b98a1d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:54.398536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-077fd8b5-5405-4f4a-9895-d50718b98a1d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:54.478953 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-077fd8b5-5405-4f4a-9895-d50718b98a1d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:54.486748 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-077fd8b5-5405-4f4a-9895-d50718b98a1d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1203 microversion: 2.1 time: 0.112845 Jul 04 09:27:54.487945 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 483/979] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:54 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1203 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:55.180900 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-d457b851-f93d-44bd-8285-48a0f49e4e86 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:55.181548 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-d457b851-f93d-44bd-8285-48a0f49e4e86 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:55.189976 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d457b851-f93d-44bd-8285-48a0f49e4e86 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:55.190439 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d457b851-f93d-44bd-8285-48a0f49e4e86 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:55.191226 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d457b851-f93d-44bd-8285-48a0f49e4e86 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:55.191674 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-d457b851-f93d-44bd-8285-48a0f49e4e86 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:55.344211 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-d457b851-f93d-44bd-8285-48a0f49e4e86 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:55.352055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-d457b851-f93d-44bd-8285-48a0f49e4e86 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1315 microversion: 2.1 time: 0.176078 Jul 04 09:27:55.352632 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 497/980] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:55 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:27:55.504815 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-dc0feee0-b2e5-4498-9d48-c393ec6db951 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:55.506854 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-dc0feee0-b2e5-4498-9d48-c393ec6db951 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:55.515410 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dc0feee0-b2e5-4498-9d48-c393ec6db951 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:55.516132 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dc0feee0-b2e5-4498-9d48-c393ec6db951 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:55.517187 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dc0feee0-b2e5-4498-9d48-c393ec6db951 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:55.517804 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dc0feee0-b2e5-4498-9d48-c393ec6db951 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:55.676987 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-dc0feee0-b2e5-4498-9d48-c393ec6db951 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:55.685922 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-dc0feee0-b2e5-4498-9d48-c393ec6db951 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.185111 Jul 04 09:27:55.686688 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 484/981] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:55 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:55.735776 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-93f2b7d8-b266-40cb-a7bc-6ecc0fbb558c req-975f846f-d5a4-47ee-908f-e1ff1a1fc7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274513ec-6bf9-4de3-98fb-11dca1f77a87", "tag": "8276b6bb-88db-41f8-9062-1b0f0ac7e174"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:55.748569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-93f2b7d8-b266-40cb-a7bc-6ecc0fbb558c req-975f846f-d5a4-47ee-908f-e1ff1a1fc7e5 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:55.749402 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-93f2b7d8-b266-40cb-a7bc-6ecc0fbb558c req-975f846f-d5a4-47ee-908f-e1ff1a1fc7e5 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:55.768632 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-93f2b7d8-b266-40cb-a7bc-6ecc0fbb558c req-975f846f-d5a4-47ee-908f-e1ff1a1fc7e5 service nova] Creating event network-changed:8276b6bb-88db-41f8-9062-1b0f0ac7e174 for instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 on hv-cinder-84456 Jul 04 09:27:55.778728 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-93f2b7d8-b266-40cb-a7bc-6ecc0fbb558c req-975f846f-d5a4-47ee-908f-e1ff1a1fc7e5 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045538 Jul 04 09:27:55.778728 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 498/982] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:27:56.371127 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-26133071-eb49-4458-a3cd-ea77c2592a75 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:56.371732 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-26133071-eb49-4458-a3cd-ea77c2592a75 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:56.377701 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26133071-eb49-4458-a3cd-ea77c2592a75 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:56.378143 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26133071-eb49-4458-a3cd-ea77c2592a75 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:56.378898 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26133071-eb49-4458-a3cd-ea77c2592a75 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:56.379331 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26133071-eb49-4458-a3cd-ea77c2592a75 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:56.538663 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-690ce05e-19c0-4a94-b52b-c0f7869daf0d req-7ed5e45b-f4e8-4528-bef5-04c1b832a4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2", "name": "network-vif-plugged", "status": "completed", "tag": "225c986c-78e4-47a5-a37e-1e7a08ee8b0b"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:27:56.542164 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-26133071-eb49-4458-a3cd-ea77c2592a75 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:56.550095 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-690ce05e-19c0-4a94-b52b-c0f7869daf0d req-7ed5e45b-f4e8-4528-bef5-04c1b832a4e1 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:56.550810 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-690ce05e-19c0-4a94-b52b-c0f7869daf0d req-7ed5e45b-f4e8-4528-bef5-04c1b832a4e1 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:56.556523 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-26133071-eb49-4458-a3cd-ea77c2592a75 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1315 microversion: 2.1 time: 0.191196 Jul 04 09:27:56.566671 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 485/983] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:56 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:56.568038 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-690ce05e-19c0-4a94-b52b-c0f7869daf0d req-7ed5e45b-f4e8-4528-bef5-04c1b832a4e1 service nova] Creating event network-vif-plugged:225c986c-78e4-47a5-a37e-1e7a08ee8b0b for instance af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 on hv-cinder-84456 Jul 04 09:27:56.573877 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-690ce05e-19c0-4a94-b52b-c0f7869daf0d req-7ed5e45b-f4e8-4528-bef5-04c1b832a4e1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040109 Jul 04 09:27:56.574543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 499/984] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:27:56.703017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-6e551d60-0eca-4040-bbce-e7a6b6a799f9 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:56.703745 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-6e551d60-0eca-4040-bbce-e7a6b6a799f9 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:56.712310 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6e551d60-0eca-4040-bbce-e7a6b6a799f9 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:56.713023 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6e551d60-0eca-4040-bbce-e7a6b6a799f9 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:56.713922 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6e551d60-0eca-4040-bbce-e7a6b6a799f9 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:56.714597 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-6e551d60-0eca-4040-bbce-e7a6b6a799f9 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:57.010559 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-6e551d60-0eca-4040-bbce-e7a6b6a799f9 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:57.018287 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-6e551d60-0eca-4040-bbce-e7a6b6a799f9 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.319446 Jul 04 09:27:57.018778 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 486/985] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:56 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:27:57.575977 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-58f833a3-dfd5-4e58-99c6-5c434ae29a71 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:57.576824 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-58f833a3-dfd5-4e58-99c6-5c434ae29a71 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:57.584640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58f833a3-dfd5-4e58-99c6-5c434ae29a71 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:57.585128 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58f833a3-dfd5-4e58-99c6-5c434ae29a71 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:57.585908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58f833a3-dfd5-4e58-99c6-5c434ae29a71 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:57.586349 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-58f833a3-dfd5-4e58-99c6-5c434ae29a71 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:57.733524 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-58f833a3-dfd5-4e58-99c6-5c434ae29a71 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:57.742272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-58f833a3-dfd5-4e58-99c6-5c434ae29a71 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1315 microversion: 2.1 time: 0.171463 Jul 04 09:27:57.742844 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 500/986] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:57 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:58.035414 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-dece5cdb-d211-45ce-a42c-02a47cf3f573 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:58.036031 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-dece5cdb-d211-45ce-a42c-02a47cf3f573 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:58.043649 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dece5cdb-d211-45ce-a42c-02a47cf3f573 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:58.044443 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dece5cdb-d211-45ce-a42c-02a47cf3f573 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:58.045440 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dece5cdb-d211-45ce-a42c-02a47cf3f573 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:58.045827 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dece5cdb-d211-45ce-a42c-02a47cf3f573 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:58.192301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-dece5cdb-d211-45ce-a42c-02a47cf3f573 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:58.201714 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-dece5cdb-d211-45ce-a42c-02a47cf3f573 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.170069 Jul 04 09:27:58.202291 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 487/987] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:58 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:58.759867 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-25dbad77-4e79-410f-af12-2da65bb77ab4 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:58.760427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-25dbad77-4e79-410f-af12-2da65bb77ab4 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:58.766752 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-25dbad77-4e79-410f-af12-2da65bb77ab4 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:58.767208 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-25dbad77-4e79-410f-af12-2da65bb77ab4 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:58.767980 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-25dbad77-4e79-410f-af12-2da65bb77ab4 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:58.768421 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-25dbad77-4e79-410f-af12-2da65bb77ab4 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:58.906806 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-25dbad77-4e79-410f-af12-2da65bb77ab4 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:58.914909 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-25dbad77-4e79-410f-af12-2da65bb77ab4 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1465 microversion: 2.1 time: 0.159625 Jul 04 09:27:58.915486 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 501/988] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:58 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:58.956551 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f6e8313b-691b-4f68-bd11-1a213904b600 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:58.957071 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f6e8313b-691b-4f68-bd11-1a213904b600 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:58.966051 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f6e8313b-691b-4f68-bd11-1a213904b600 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:58.966512 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f6e8313b-691b-4f68-bd11-1a213904b600 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:58.967299 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f6e8313b-691b-4f68-bd11-1a213904b600 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:58.967745 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f6e8313b-691b-4f68-bd11-1a213904b600 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:58.995151 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f6e8313b-691b-4f68-bd11-1a213904b600 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:27:59.078043 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f6e8313b-691b-4f68-bd11-1a213904b600 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "DELETE /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 204 len: 0 microversion: 2.1 time: 0.125009 Jul 04 09:27:59.078986 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 488/989] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:27:58 2022] DELETE /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:27:59.088734 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-87b1baa8-fe2a-4356-872c-acd136410703 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:59.089475 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-87b1baa8-fe2a-4356-872c-acd136410703 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:59.098410 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87b1baa8-fe2a-4356-872c-acd136410703 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:59.098985 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87b1baa8-fe2a-4356-872c-acd136410703 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:59.099708 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87b1baa8-fe2a-4356-872c-acd136410703 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:59.100328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-87b1baa8-fe2a-4356-872c-acd136410703 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:59.222776 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-bad3f851-475b-4123-82a6-75bb1fea781a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:27:59.223725 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-bad3f851-475b-4123-82a6-75bb1fea781a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:27:59.231530 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bad3f851-475b-4123-82a6-75bb1fea781a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:59.232120 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bad3f851-475b-4123-82a6-75bb1fea781a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:59.233014 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bad3f851-475b-4123-82a6-75bb1fea781a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:27:59.233584 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-bad3f851-475b-4123-82a6-75bb1fea781a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:27:59.272131 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-87b1baa8-fe2a-4356-872c-acd136410703 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:59.282217 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-87b1baa8-fe2a-4356-872c-acd136410703 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1471 microversion: 2.1 time: 0.199136 Jul 04 09:27:59.285071 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 502/990] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:59 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:27:59.405488 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-bad3f851-475b-4123-82a6-75bb1fea781a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:27:59.414973 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-bad3f851-475b-4123-82a6-75bb1fea781a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.197344 Jul 04 09:27:59.415621 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 489/991] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:27:59 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:00.302418 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7ac5091a-bad6-462d-a817-026dbe78aa3e tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:00.303626 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7ac5091a-bad6-462d-a817-026dbe78aa3e tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:00.310178 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7ac5091a-bad6-462d-a817-026dbe78aa3e tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:00.310731 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7ac5091a-bad6-462d-a817-026dbe78aa3e tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:00.311548 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7ac5091a-bad6-462d-a817-026dbe78aa3e tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:00.312001 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7ac5091a-bad6-462d-a817-026dbe78aa3e tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:00.434399 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-b5a8e1ed-9a45-4e51-b0cf-c58a9130759e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:00.435175 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-b5a8e1ed-9a45-4e51-b0cf-c58a9130759e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:00.447345 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5a8e1ed-9a45-4e51-b0cf-c58a9130759e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:00.448194 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5a8e1ed-9a45-4e51-b0cf-c58a9130759e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:00.449145 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5a8e1ed-9a45-4e51-b0cf-c58a9130759e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:00.449534 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-b5a8e1ed-9a45-4e51-b0cf-c58a9130759e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:00.484138 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7ac5091a-bad6-462d-a817-026dbe78aa3e tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:00.494106 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7ac5091a-bad6-462d-a817-026dbe78aa3e tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1471 microversion: 2.1 time: 0.195133 Jul 04 09:28:00.494488 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 503/992] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:00 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:00.613715 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-b5a8e1ed-9a45-4e51-b0cf-c58a9130759e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:00.622532 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-b5a8e1ed-9a45-4e51-b0cf-c58a9130759e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.193949 Jul 04 09:28:00.623116 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 490/993] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:00 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:28:01.133129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-2ad62650-0257-400a-b1aa-bcbd17ffe449 req-556af38e-a9e2-47b0-930a-9c2482bf9753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2", "name": "network-vif-deleted", "tag": "225c986c-78e4-47a5-a37e-1e7a08ee8b0b"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:01.142228 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-2ad62650-0257-400a-b1aa-bcbd17ffe449 req-556af38e-a9e2-47b0-930a-9c2482bf9753 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:01.142679 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-2ad62650-0257-400a-b1aa-bcbd17ffe449 req-556af38e-a9e2-47b0-930a-9c2482bf9753 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:01.157885 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-2ad62650-0257-400a-b1aa-bcbd17ffe449 req-556af38e-a9e2-47b0-930a-9c2482bf9753 service nova] Creating event network-vif-deleted:225c986c-78e4-47a5-a37e-1e7a08ee8b0b for instance af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 on hv-cinder-84456 Jul 04 09:28:01.164887 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-2ad62650-0257-400a-b1aa-bcbd17ffe449 req-556af38e-a9e2-47b0-930a-9c2482bf9753 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035426 Jul 04 09:28:01.165779 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 504/994] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:01.512238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:01.512848 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:01.519520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:01.519971 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:01.520731 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:01.522387 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:01.559791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:01.560245 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:01.560698 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lazy-loading 'fault' on Instance uuid af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:28:01.603660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b2f682cc1847a180eafa93f9d90d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ffc237d7f243dc9d0efe8a367b5077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:01.611063 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ea906a09-1a43-4688-baf4-237197a92a9c tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 200 len: 1305 microversion: 2.1 time: 0.102720 Jul 04 09:28:01.611620 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 491/995] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:01 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:01.641478 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c0e4084e-cfd4-4a5c-8494-724a2668c2f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:01.642253 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c0e4084e-cfd4-4a5c-8494-724a2668c2f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:01.653267 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c0e4084e-cfd4-4a5c-8494-724a2668c2f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:01.653816 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c0e4084e-cfd4-4a5c-8494-724a2668c2f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:01.654673 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c0e4084e-cfd4-4a5c-8494-724a2668c2f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:01.655217 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c0e4084e-cfd4-4a5c-8494-724a2668c2f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:01.809898 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c0e4084e-cfd4-4a5c-8494-724a2668c2f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:01.817743 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c0e4084e-cfd4-4a5c-8494-724a2668c2f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.181839 Jul 04 09:28:01.819004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 505/996] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:01 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:02.627950 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a9e73864-48e2-44cd-9e01-5dfccc607d30 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:02.628486 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-a9e73864-48e2-44cd-9e01-5dfccc607d30 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] [instance: af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:02.635044 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a9e73864-48e2-44cd-9e01-5dfccc607d30 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:02.635501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a9e73864-48e2-44cd-9e01-5dfccc607d30 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:02.636307 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a9e73864-48e2-44cd-9e01-5dfccc607d30 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:02.636749 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-a9e73864-48e2-44cd-9e01-5dfccc607d30 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:02.650813 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-a9e73864-48e2-44cd-9e01-5dfccc607d30 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] HTTP exception thrown: Instance af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 could not be found. Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a9e73864-48e2-44cd-9e01-5dfccc607d30 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Request method failure captured: Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 HTTP/1.1 Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrKOWXTDJnCf0Moa4xEMfRkcNzsCTcuNrrf2LU4tHuXtpEUJx0OWiG2QTab6eiNc3m_ZOsPRjcGasPQkI9-MAVIgmsIZIPr--zY-HjnKb04FmqxqG5X0U2Ev_EfkkGx0vlE_wzOks-qPdUeMhZCSVh76dtRW-RNWS66K-cz1U3rUmE4 Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 21ffc237d7f243dc9d0efe8a367b5077 Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-VolumesNegativeTest-1742999466 Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:28:02.652501 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/21ffc237d7f243dc9d0efe8a367b5077"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/21ffc237d7f243dc9d0efe8a367b5077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/21ffc237d7f243dc9d0efe8a367b5077"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_21ffc237d7f243dc9d0efe8a367b5077", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-VolumesNegativeTest-1742999466 Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 21ffc237d7f243dc9d0efe8a367b5077 Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-VolumesNegativeTest-1742999466 Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-VolumesNegativeTest-1742999466-project Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 21b2f682cc1847a180eafa93f9d90d35 Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-VolumesNegativeTest-1742999466-project Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 could not be found. Jul 04 09:28:02.654258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2'} Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 could not be found. Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:28:02.655319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 could not be found. Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 could not be found. Jul 04 09:28:02.656925 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:28:02.658170 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-a9e73864-48e2-44cd-9e01-5dfccc607d30 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] Returning 404 to user: Instance af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:28:02.658170 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-a9e73864-48e2-44cd-9e01-5dfccc607d30 tempest-VolumesNegativeTest-1742999466 tempest-VolumesNegativeTest-1742999466-project] 10.222.0.71 "GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2" status: 404 len: 111 microversion: 2.1 time: 0.030089 Jul 04 09:28:02.658170 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 492/997] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:02 2022] GET /compute/v2.1/servers/af52a051-7ffe-4cbc-bca7-a0e21ee3d3d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:28:02.836325 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-227f1823-f836-4bf8-9042-d88cddca978d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:02.837696 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-227f1823-f836-4bf8-9042-d88cddca978d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:02.844866 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-227f1823-f836-4bf8-9042-d88cddca978d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:02.845954 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-227f1823-f836-4bf8-9042-d88cddca978d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:02.847003 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-227f1823-f836-4bf8-9042-d88cddca978d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:02.847664 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-227f1823-f836-4bf8-9042-d88cddca978d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:03.011134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=4 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:03.036504 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=12 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:03.061549 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-227f1823-f836-4bf8-9042-d88cddca978d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:03.071624 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-227f1823-f836-4bf8-9042-d88cddca978d tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.239748 Jul 04 09:28:03.072861 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 506/998] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:02 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:04.090704 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ef6b4c0d-bc01-4c80-8176-dcfeb251af5a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:04.092485 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ef6b4c0d-bc01-4c80-8176-dcfeb251af5a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:04.100180 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=8 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:04.103378 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef6b4c0d-bc01-4c80-8176-dcfeb251af5a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:04.104210 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef6b4c0d-bc01-4c80-8176-dcfeb251af5a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:04.105265 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef6b4c0d-bc01-4c80-8176-dcfeb251af5a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:04.105985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef6b4c0d-bc01-4c80-8176-dcfeb251af5a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:04.274258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ef6b4c0d-bc01-4c80-8176-dcfeb251af5a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:04.283477 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ef6b4c0d-bc01-4c80-8176-dcfeb251af5a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.196850 Jul 04 09:28:04.284046 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 493/999] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:04 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:05.301383 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ab8c2e7a-2644-4600-b299-4120345f0a39 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:05.302034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ab8c2e7a-2644-4600-b299-4120345f0a39 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:05.310059 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab8c2e7a-2644-4600-b299-4120345f0a39 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:05.310511 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab8c2e7a-2644-4600-b299-4120345f0a39 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:05.311273 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab8c2e7a-2644-4600-b299-4120345f0a39 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:05.311728 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ab8c2e7a-2644-4600-b299-4120345f0a39 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:05.459493 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ab8c2e7a-2644-4600-b299-4120345f0a39 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:05.468325 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ab8c2e7a-2644-4600-b299-4120345f0a39 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.170678 Jul 04 09:28:05.468885 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 507/1000] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:05 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:06.485597 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-cf55c9d9-d914-425a-9e9f-ce5cdff225f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:06.486349 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-cf55c9d9-d914-425a-9e9f-ce5cdff225f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:06.497460 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cf55c9d9-d914-425a-9e9f-ce5cdff225f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:06.498424 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cf55c9d9-d914-425a-9e9f-ce5cdff225f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:06.499747 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cf55c9d9-d914-425a-9e9f-ce5cdff225f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:06.500177 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-cf55c9d9-d914-425a-9e9f-ce5cdff225f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:06.546461 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-fa7ac6e8-0ad7-4a0e-95eb-eaf4d07bd8b9 req-b6c008bb-e8d9-4e34-ad17-1910abdda7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274513ec-6bf9-4de3-98fb-11dca1f77a87", "name": "network-vif-plugged", "status": "completed", "tag": "8276b6bb-88db-41f8-9062-1b0f0ac7e174"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:06.557128 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-fa7ac6e8-0ad7-4a0e-95eb-eaf4d07bd8b9 req-b6c008bb-e8d9-4e34-ad17-1910abdda7b5 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:06.557561 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-fa7ac6e8-0ad7-4a0e-95eb-eaf4d07bd8b9 req-b6c008bb-e8d9-4e34-ad17-1910abdda7b5 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:06.571176 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-fa7ac6e8-0ad7-4a0e-95eb-eaf4d07bd8b9 req-b6c008bb-e8d9-4e34-ad17-1910abdda7b5 service nova] Creating event network-vif-plugged:8276b6bb-88db-41f8-9062-1b0f0ac7e174 for instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 on hv-cinder-84456 Jul 04 09:28:06.576828 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-fa7ac6e8-0ad7-4a0e-95eb-eaf4d07bd8b9 req-b6c008bb-e8d9-4e34-ad17-1910abdda7b5 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033785 Jul 04 09:28:06.577634 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 508/1001] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:28:06.679869 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-cf55c9d9-d914-425a-9e9f-ce5cdff225f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:06.687542 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-cf55c9d9-d914-425a-9e9f-ce5cdff225f7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.205925 Jul 04 09:28:06.688140 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 494/1002] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:06 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:06.726278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-833188332", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1745159673", "security_groups": [{"name": "tempest-secgroup-smoke-293614396"}], "block_device_mapping_v2": [{"uuid": "a0ce61cf-6aa4-42bc-8a7b-364a1a6a258c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ee02fb8-6fb5-48a7-85e0-025a20abf3c8"}]}} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:06.851295 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.network.neutron [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] validate_networks() for [('3ee02fb8-6fb5-48a7-85e0-025a20abf3c8', None, None, None, None, None)] {{(pid=117665) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:28:07.250628 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Flavor limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:28:07.251189 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Image limits 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:28:07.251675 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Flavor pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:28:07.252091 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Image pref 0:0:0 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:28:07.252508 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.virt.hardware [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:28:07.262167 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:07.262625 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:07.263447 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:07.263897 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:07.281628 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Getting quotas for project 4fe236d825ae40f793bf2a5bccedc3cd. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:28:07.287054 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.quota [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Getting quotas for user 70733d7f6b8b42a39425ebc94e1ec1f4 and project 4fe236d825ae40f793bf2a5bccedc3cd. Resources: {'instances', 'ram', 'cores'} {{(pid=117665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:28:07.368530 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Going to run 1 instances... {{(pid=117665) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:28:07.371242 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0ce61cf-6aa4-42bc-8a7b-364a1a6a258c',volume_size=None,volume_type=None)] {{(pid=117665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:28:07.522944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-775edfe1-2aee-4b95-8093-ffe302131483 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.802601 Jul 04 09:28:07.523980 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 509/1003] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:28:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:28:07.534110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-43c9214c-1897-4347-a89f-da44b8e6b51c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:07.535721 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-43c9214c-1897-4347-a89f-da44b8e6b51c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:07.604651 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-43c9214c-1897-4347-a89f-da44b8e6b51c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:07.612705 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-43c9214c-1897-4347-a89f-da44b8e6b51c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1094 microversion: 2.1 time: 0.082478 Jul 04 09:28:07.613336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 495/1004] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:07 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:28:07.712022 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3c3d5003-75f2-48f1-a1e4-17b5f1734794 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:07.713146 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3c3d5003-75f2-48f1-a1e4-17b5f1734794 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:07.732293 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c3d5003-75f2-48f1-a1e4-17b5f1734794 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:07.732966 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c3d5003-75f2-48f1-a1e4-17b5f1734794 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:07.733974 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c3d5003-75f2-48f1-a1e4-17b5f1734794 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:07.734316 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3c3d5003-75f2-48f1-a1e4-17b5f1734794 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:07.895557 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3c3d5003-75f2-48f1-a1e4-17b5f1734794 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:07.904018 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3c3d5003-75f2-48f1-a1e4-17b5f1734794 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1259 microversion: 2.1 time: 0.201178 Jul 04 09:28:07.904537 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 510/1005] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:07 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:28:08.634365 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d79ded92-4fa6-4cb1-9a82-0474fcc30920 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:08.635029 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d79ded92-4fa6-4cb1-9a82-0474fcc30920 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:08.646414 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d79ded92-4fa6-4cb1-9a82-0474fcc30920 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:08.647430 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d79ded92-4fa6-4cb1-9a82-0474fcc30920 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:08.648604 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d79ded92-4fa6-4cb1-9a82-0474fcc30920 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:08.649840 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d79ded92-4fa6-4cb1-9a82-0474fcc30920 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:08.671387 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:08.751756 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-d79ded92-4fa6-4cb1-9a82-0474fcc30920 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:08.760060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d79ded92-4fa6-4cb1-9a82-0474fcc30920 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1200 microversion: 2.1 time: 0.131873 Jul 04 09:28:08.761083 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 496/1006] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:08 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1200 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:08.922443 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-93efa3e4-70c9-414f-bde3-5f22ef67fa66 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:08.923069 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-93efa3e4-70c9-414f-bde3-5f22ef67fa66 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:08.930557 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-93efa3e4-70c9-414f-bde3-5f22ef67fa66 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:08.931018 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-93efa3e4-70c9-414f-bde3-5f22ef67fa66 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:08.931803 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-93efa3e4-70c9-414f-bde3-5f22ef67fa66 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:08.932243 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-93efa3e4-70c9-414f-bde3-5f22ef67fa66 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:09.082391 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-93efa3e4-70c9-414f-bde3-5f22ef67fa66 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:09.090552 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-93efa3e4-70c9-414f-bde3-5f22ef67fa66 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1443 microversion: 2.1 time: 0.172069 Jul 04 09:28:09.091427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 511/1007] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:08 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1443 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:09.111318 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-96cc52c8-090d-4372-810a-f994338b7a94 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:09.111935 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-96cc52c8-090d-4372-810a-f994338b7a94 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:09.123537 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-96cc52c8-090d-4372-810a-f994338b7a94 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:09.123953 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-96cc52c8-090d-4372-810a-f994338b7a94 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:09.124748 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-96cc52c8-090d-4372-810a-f994338b7a94 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:09.125422 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-96cc52c8-090d-4372-810a-f994338b7a94 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:09.308712 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-96cc52c8-090d-4372-810a-f994338b7a94 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:09.316471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-96cc52c8-090d-4372-810a-f994338b7a94 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1443 microversion: 2.1 time: 0.210286 Jul 04 09:28:09.317032 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 497/1008] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:09 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1443 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:09.778208 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a543a338-e90c-4b9a-97a7-70b59a81d16b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:09.778835 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a543a338-e90c-4b9a-97a7-70b59a81d16b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:09.785109 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a543a338-e90c-4b9a-97a7-70b59a81d16b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:09.785576 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a543a338-e90c-4b9a-97a7-70b59a81d16b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:09.786568 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a543a338-e90c-4b9a-97a7-70b59a81d16b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:09.787627 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a543a338-e90c-4b9a-97a7-70b59a81d16b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:10.085573 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a543a338-e90c-4b9a-97a7-70b59a81d16b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:10.095676 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a543a338-e90c-4b9a-97a7-70b59a81d16b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.320997 Jul 04 09:28:10.107709 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 512/1009] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:09 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:10.164903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-8d32df58-b141-4191-87ad-bb44495fb08b req-e3e98948-24dc-4172-91c6-088eef673a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee3a79da-9564-4eed-8be7-970da53166b0", "tag": "fbc8dd71-f265-41b0-a1b2-2c772fb0242d"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:10.176966 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8d32df58-b141-4191-87ad-bb44495fb08b req-e3e98948-24dc-4172-91c6-088eef673a43 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:10.178909 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-8d32df58-b141-4191-87ad-bb44495fb08b req-e3e98948-24dc-4172-91c6-088eef673a43 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:10.192527 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-8d32df58-b141-4191-87ad-bb44495fb08b req-e3e98948-24dc-4172-91c6-088eef673a43 service nova] Creating event network-changed:fbc8dd71-f265-41b0-a1b2-2c772fb0242d for instance ee3a79da-9564-4eed-8be7-970da53166b0 on hv-cinder-84456 Jul 04 09:28:10.202905 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-8d32df58-b141-4191-87ad-bb44495fb08b req-e3e98948-24dc-4172-91c6-088eef673a43 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043281 Jul 04 09:28:10.203510 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 498/1010] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:11.113574 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-4de03171-08de-4e24-a1ec-94cadc2804aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:11.114122 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-4de03171-08de-4e24-a1ec-94cadc2804aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:11.121082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4de03171-08de-4e24-a1ec-94cadc2804aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:11.121847 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4de03171-08de-4e24-a1ec-94cadc2804aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:11.122683 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4de03171-08de-4e24-a1ec-94cadc2804aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:11.123305 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-4de03171-08de-4e24-a1ec-94cadc2804aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:11.378918 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-4de03171-08de-4e24-a1ec-94cadc2804aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:11.386445 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=100 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:11.398305 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-4de03171-08de-4e24-a1ec-94cadc2804aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.288845 Jul 04 09:28:11.399126 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 513/1011] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:11 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:11.595863 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-df814655-b3e8-42b7-a0da-b01c429dc858 req-4250b5a1-6895-459a-ad01-1336a535544b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274513ec-6bf9-4de3-98fb-11dca1f77a87", "tag": "8276b6bb-88db-41f8-9062-1b0f0ac7e174"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:11.604534 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-df814655-b3e8-42b7-a0da-b01c429dc858 req-4250b5a1-6895-459a-ad01-1336a535544b service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:11.605130 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-df814655-b3e8-42b7-a0da-b01c429dc858 req-4250b5a1-6895-459a-ad01-1336a535544b service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:11.616928 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-df814655-b3e8-42b7-a0da-b01c429dc858 req-4250b5a1-6895-459a-ad01-1336a535544b service nova] Creating event network-changed:8276b6bb-88db-41f8-9062-1b0f0ac7e174 for instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 on hv-cinder-84456 Jul 04 09:28:11.621857 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-df814655-b3e8-42b7-a0da-b01c429dc858 req-4250b5a1-6895-459a-ad01-1336a535544b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030720 Jul 04 09:28:11.622619 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 499/1012] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:12.417187 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-27aeceec-29de-42d9-981b-21e6a71ae32c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:12.418000 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-27aeceec-29de-42d9-981b-21e6a71ae32c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:12.425055 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27aeceec-29de-42d9-981b-21e6a71ae32c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:12.425755 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27aeceec-29de-42d9-981b-21e6a71ae32c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:12.426535 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27aeceec-29de-42d9-981b-21e6a71ae32c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:12.426975 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-27aeceec-29de-42d9-981b-21e6a71ae32c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:12.570639 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-27aeceec-29de-42d9-981b-21e6a71ae32c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:12.579748 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-27aeceec-29de-42d9-981b-21e6a71ae32c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.168351 Jul 04 09:28:12.580342 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 514/1013] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:12 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:13.598470 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fb5dca1d-5d6a-4d69-87c0-347b0b70b007 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:13.599177 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fb5dca1d-5d6a-4d69-87c0-347b0b70b007 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:13.605564 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb5dca1d-5d6a-4d69-87c0-347b0b70b007 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:13.606021 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb5dca1d-5d6a-4d69-87c0-347b0b70b007 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:13.606820 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb5dca1d-5d6a-4d69-87c0-347b0b70b007 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:13.607263 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fb5dca1d-5d6a-4d69-87c0-347b0b70b007 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:13.756679 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fb5dca1d-5d6a-4d69-87c0-347b0b70b007 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:13.764559 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fb5dca1d-5d6a-4d69-87c0-347b0b70b007 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.171124 Jul 04 09:28:13.765129 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 500/1014] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:13 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:14.784268 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-359d56c7-cb2d-4ee2-90c1-4ed548ba3edd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:14.784899 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-359d56c7-cb2d-4ee2-90c1-4ed548ba3edd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:14.787335 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:14.793368 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-359d56c7-cb2d-4ee2-90c1-4ed548ba3edd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:14.793830 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-359d56c7-cb2d-4ee2-90c1-4ed548ba3edd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:14.794600 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-359d56c7-cb2d-4ee2-90c1-4ed548ba3edd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:14.795044 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-359d56c7-cb2d-4ee2-90c1-4ed548ba3edd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:14.924011 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-359d56c7-cb2d-4ee2-90c1-4ed548ba3edd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:14.932250 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-359d56c7-cb2d-4ee2-90c1-4ed548ba3edd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.151846 Jul 04 09:28:14.932813 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 515/1015] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:14 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:15.949746 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-38be1245-fe1c-4c4f-9b58-739af065bff6 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:15.950375 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-38be1245-fe1c-4c4f-9b58-739af065bff6 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:15.957142 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38be1245-fe1c-4c4f-9b58-739af065bff6 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:15.957606 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38be1245-fe1c-4c4f-9b58-739af065bff6 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:15.958377 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38be1245-fe1c-4c4f-9b58-739af065bff6 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:15.959454 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-38be1245-fe1c-4c4f-9b58-739af065bff6 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:16.095999 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-38be1245-fe1c-4c4f-9b58-739af065bff6 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:16.103609 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-38be1245-fe1c-4c4f-9b58-739af065bff6 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.157917 Jul 04 09:28:16.104166 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 501/1016] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:15 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:17.120380 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c61cb0ab-a6f9-4044-a358-f0f2a365336c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:17.121057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c61cb0ab-a6f9-4044-a358-f0f2a365336c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:17.127268 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c61cb0ab-a6f9-4044-a358-f0f2a365336c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:17.127723 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c61cb0ab-a6f9-4044-a358-f0f2a365336c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:17.128520 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c61cb0ab-a6f9-4044-a358-f0f2a365336c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:17.128963 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c61cb0ab-a6f9-4044-a358-f0f2a365336c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:17.259949 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c61cb0ab-a6f9-4044-a358-f0f2a365336c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:17.267508 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c61cb0ab-a6f9-4044-a358-f0f2a365336c tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.151236 Jul 04 09:28:17.268080 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 516/1017] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:17 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:18.284583 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fd4cb33e-f5ef-4b86-8fd2-4f03f1fc028b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:18.285235 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fd4cb33e-f5ef-4b86-8fd2-4f03f1fc028b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:18.288440 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:18.289127 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:18.294896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd4cb33e-f5ef-4b86-8fd2-4f03f1fc028b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:18.295356 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd4cb33e-f5ef-4b86-8fd2-4f03f1fc028b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:18.296153 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd4cb33e-f5ef-4b86-8fd2-4f03f1fc028b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:18.296661 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fd4cb33e-f5ef-4b86-8fd2-4f03f1fc028b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:18.431326 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fd4cb33e-f5ef-4b86-8fd2-4f03f1fc028b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:18.438892 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fd4cb33e-f5ef-4b86-8fd2-4f03f1fc028b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.158185 Jul 04 09:28:18.439465 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 502/1018] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:18 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:19.455289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5194702f-f9b3-4a6d-a3db-9b4a5c774165 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:19.455908 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-5194702f-f9b3-4a6d-a3db-9b4a5c774165 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:19.457814 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:19.458643 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=6 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:28:19.465768 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5194702f-f9b3-4a6d-a3db-9b4a5c774165 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:19.466224 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5194702f-f9b3-4a6d-a3db-9b4a5c774165 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:19.467000 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5194702f-f9b3-4a6d-a3db-9b4a5c774165 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:19.467439 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-5194702f-f9b3-4a6d-a3db-9b4a5c774165 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:19.601376 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-5194702f-f9b3-4a6d-a3db-9b4a5c774165 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:19.608946 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5194702f-f9b3-4a6d-a3db-9b4a5c774165 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.157540 Jul 04 09:28:19.609550 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 517/1019] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:19 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:20.585710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-510de43b-345e-4aeb-8597-fdf2092e722d req-5d452791-ca08-4495-b66a-a6415b8d76aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee3a79da-9564-4eed-8be7-970da53166b0", "name": "network-vif-plugged", "status": "completed", "tag": "fbc8dd71-f265-41b0-a1b2-2c772fb0242d"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:20.596394 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-510de43b-345e-4aeb-8597-fdf2092e722d req-5d452791-ca08-4495-b66a-a6415b8d76aa service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:20.597551 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-510de43b-345e-4aeb-8597-fdf2092e722d req-5d452791-ca08-4495-b66a-a6415b8d76aa service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:20.611937 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-510de43b-345e-4aeb-8597-fdf2092e722d req-5d452791-ca08-4495-b66a-a6415b8d76aa service nova] Creating event network-vif-plugged:fbc8dd71-f265-41b0-a1b2-2c772fb0242d for instance ee3a79da-9564-4eed-8be7-970da53166b0 on hv-cinder-84456 Jul 04 09:28:20.619413 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-510de43b-345e-4aeb-8597-fdf2092e722d req-5d452791-ca08-4495-b66a-a6415b8d76aa service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037225 Jul 04 09:28:20.619803 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 503/1020] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:28:20.635769 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-7f81919a-3044-4112-b5c7-617a40dc129d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:20.636528 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-7f81919a-3044-4112-b5c7-617a40dc129d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:20.645577 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f81919a-3044-4112-b5c7-617a40dc129d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:20.647584 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f81919a-3044-4112-b5c7-617a40dc129d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:20.648411 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f81919a-3044-4112-b5c7-617a40dc129d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:20.649091 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-7f81919a-3044-4112-b5c7-617a40dc129d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:20.791877 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-7f81919a-3044-4112-b5c7-617a40dc129d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:20.799582 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-7f81919a-3044-4112-b5c7-617a40dc129d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.175750 Jul 04 09:28:20.800175 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 518/1021] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:20 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:28:21.816703 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c3c9ea07-fd2b-49f4-a3bb-29773b002579 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:21.817434 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c3c9ea07-fd2b-49f4-a3bb-29773b002579 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:21.824475 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3c9ea07-fd2b-49f4-a3bb-29773b002579 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:21.825065 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3c9ea07-fd2b-49f4-a3bb-29773b002579 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:21.825863 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3c9ea07-fd2b-49f4-a3bb-29773b002579 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:21.826308 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c3c9ea07-fd2b-49f4-a3bb-29773b002579 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:21.965959 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c3c9ea07-fd2b-49f4-a3bb-29773b002579 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:21.973708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c3c9ea07-fd2b-49f4-a3bb-29773b002579 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1265 microversion: 2.1 time: 0.161740 Jul 04 09:28:21.974270 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 504/1022] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:21 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:22.991068 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-084ac9f1-e67f-4d4d-91dc-d22dba6c2d39 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:22.991689 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-084ac9f1-e67f-4d4d-91dc-d22dba6c2d39 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:22.998241 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-084ac9f1-e67f-4d4d-91dc-d22dba6c2d39 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:22.998697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-084ac9f1-e67f-4d4d-91dc-d22dba6c2d39 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:22.999461 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-084ac9f1-e67f-4d4d-91dc-d22dba6c2d39 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:22.999901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-084ac9f1-e67f-4d4d-91dc-d22dba6c2d39 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:23.129969 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-084ac9f1-e67f-4d4d-91dc-d22dba6c2d39 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:23.137745 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-084ac9f1-e67f-4d4d-91dc-d22dba6c2d39 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1452 microversion: 2.1 time: 0.150897 Jul 04 09:28:23.138316 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 519/1023] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:22 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:28:23.155020 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-67bda983-2209-4b83-872f-de74a0a2bd66 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:28:23.155634 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-67bda983-2209-4b83-872f-de74a0a2bd66 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:28:23.161991 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67bda983-2209-4b83-872f-de74a0a2bd66 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:23.163054 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67bda983-2209-4b83-872f-de74a0a2bd66 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:23.163928 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67bda983-2209-4b83-872f-de74a0a2bd66 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:23.164362 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-67bda983-2209-4b83-872f-de74a0a2bd66 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:23.297717 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-67bda983-2209-4b83-872f-de74a0a2bd66 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:28:23.305240 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-67bda983-2209-4b83-872f-de74a0a2bd66 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1452 microversion: 2.1 time: 0.154967 Jul 04 09:28:23.305798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 505/1024] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:28:23 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:28:24.968381 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-03719d98-f328-4a64-bc25-6be49b2aeac3 req-56b8b9b9-f281-4963-a8a0-157fea8df476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee3a79da-9564-4eed-8be7-970da53166b0", "tag": "fbc8dd71-f265-41b0-a1b2-2c772fb0242d"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:28:24.977622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-03719d98-f328-4a64-bc25-6be49b2aeac3 req-56b8b9b9-f281-4963-a8a0-157fea8df476 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:28:24.978072 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-03719d98-f328-4a64-bc25-6be49b2aeac3 req-56b8b9b9-f281-4963-a8a0-157fea8df476 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:28:24.988933 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-03719d98-f328-4a64-bc25-6be49b2aeac3 req-56b8b9b9-f281-4963-a8a0-157fea8df476 service nova] Creating event network-changed:fbc8dd71-f265-41b0-a1b2-2c772fb0242d for instance ee3a79da-9564-4eed-8be7-970da53166b0 on hv-cinder-84456 Jul 04 09:28:24.994789 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-03719d98-f328-4a64-bc25-6be49b2aeac3 req-56b8b9b9-f281-4963-a8a0-157fea8df476 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030048 Jul 04 09:28:24.995577 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 520/1025] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:29:17.492059 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:29:17.492702 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Mon Jul 4 09:29:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:30:09.152097 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75e9ebe1-1747-48c9-9501-a3edf5159b52] AMQP server on 10.222.0.71:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 04 09:30:09.152716 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=7 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:09.153396 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=46 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:09.157829 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-464a74e2-3611-45e5-a187-58eab36140b7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:30:09.158372 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-464a74e2-3611-45e5-a187-58eab36140b7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:09.165191 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-464a74e2-3611-45e5-a187-58eab36140b7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:09.165680 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-464a74e2-3611-45e5-a187-58eab36140b7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:09.166710 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-464a74e2-3611-45e5-a187-58eab36140b7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:09.167157 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-464a74e2-3611-45e5-a187-58eab36140b7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:09.189224 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.objects.instance [None req-464a74e2-3611-45e5-a187-58eab36140b7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lazy-loading 'flavor' on Instance uuid 274513ec-6bf9-4de3-98fb-11dca1f77a87 {{(pid=117664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:30:09.299810 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-464a74e2-3611-45e5-a187-58eab36140b7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "POST /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87/action" status: 202 len: 0 microversion: 2.1 time: 0.150401 Jul 04 09:30:09.300395 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 506/1026] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:30:09 2022] POST /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:30:09.308052 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=11 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:09.308922 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=38 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:09.313730 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9476517f-4fd1-42cf-a818-05835cfb16c0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:09.314434 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9476517f-4fd1-42cf-a818-05835cfb16c0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:09.321740 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9476517f-4fd1-42cf-a818-05835cfb16c0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:09.323417 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9476517f-4fd1-42cf-a818-05835cfb16c0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:09.324195 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9476517f-4fd1-42cf-a818-05835cfb16c0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:09.324633 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9476517f-4fd1-42cf-a818-05835cfb16c0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:09.574051 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9476517f-4fd1-42cf-a818-05835cfb16c0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:09.581669 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9476517f-4fd1-42cf-a818-05835cfb16c0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.276658 Jul 04 09:30:09.582222 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 521/1027] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:09 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:10.600336 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-555a4c40-d3ec-43ff-bc14-a462e01227b5 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:10.601022 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-555a4c40-d3ec-43ff-bc14-a462e01227b5 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:10.611674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-555a4c40-d3ec-43ff-bc14-a462e01227b5 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:10.612325 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-555a4c40-d3ec-43ff-bc14-a462e01227b5 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:10.613127 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-555a4c40-d3ec-43ff-bc14-a462e01227b5 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:10.613589 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-555a4c40-d3ec-43ff-bc14-a462e01227b5 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:10.621406 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] [75e9ebe1-1747-48c9-9501-a3edf5159b52] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 58316. Jul 04 09:30:10.833056 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-555a4c40-d3ec-43ff-bc14-a462e01227b5 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:10.840907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-555a4c40-d3ec-43ff-bc14-a462e01227b5 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.245427 Jul 04 09:30:10.841513 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 507/1028] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:10 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:11.859811 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6853e152-7b64-4fb2-9cd5-1c81150747e0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:11.860434 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6853e152-7b64-4fb2-9cd5-1c81150747e0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:11.867017 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6853e152-7b64-4fb2-9cd5-1c81150747e0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:11.867476 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6853e152-7b64-4fb2-9cd5-1c81150747e0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:11.868248 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6853e152-7b64-4fb2-9cd5-1c81150747e0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:11.869289 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6853e152-7b64-4fb2-9cd5-1c81150747e0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:11.999858 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6853e152-7b64-4fb2-9cd5-1c81150747e0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:12.007324 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6853e152-7b64-4fb2-9cd5-1c81150747e0 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.151532 Jul 04 09:30:12.007916 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 522/1029] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:11 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:13.024536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-12d9e4cb-5b3a-4971-8708-655f93ac0817 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:13.026267 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-12d9e4cb-5b3a-4971-8708-655f93ac0817 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:13.032708 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12d9e4cb-5b3a-4971-8708-655f93ac0817 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:13.033201 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12d9e4cb-5b3a-4971-8708-655f93ac0817 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:13.034026 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12d9e4cb-5b3a-4971-8708-655f93ac0817 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:13.034461 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-12d9e4cb-5b3a-4971-8708-655f93ac0817 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:13.168298 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-12d9e4cb-5b3a-4971-8708-655f93ac0817 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:13.176032 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-12d9e4cb-5b3a-4971-8708-655f93ac0817 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.155376 Jul 04 09:30:13.176632 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 508/1030] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:13 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:14.193504 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9b7075ee-503a-4a81-9808-a97fad9813fe tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:14.194123 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9b7075ee-503a-4a81-9808-a97fad9813fe tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:14.200750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9b7075ee-503a-4a81-9808-a97fad9813fe tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:14.201250 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9b7075ee-503a-4a81-9808-a97fad9813fe tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:14.202103 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9b7075ee-503a-4a81-9808-a97fad9813fe tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:14.202546 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9b7075ee-503a-4a81-9808-a97fad9813fe tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:14.333291 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9b7075ee-503a-4a81-9808-a97fad9813fe tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:14.341065 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9b7075ee-503a-4a81-9808-a97fad9813fe tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.151578 Jul 04 09:30:14.341614 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 523/1031] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:14 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:15.363387 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-37c46136-a30a-47f6-a440-30ffe7b9f016 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:15.364418 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-37c46136-a30a-47f6-a440-30ffe7b9f016 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:15.374518 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37c46136-a30a-47f6-a440-30ffe7b9f016 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:15.375245 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37c46136-a30a-47f6-a440-30ffe7b9f016 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:15.376492 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37c46136-a30a-47f6-a440-30ffe7b9f016 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:15.377238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-37c46136-a30a-47f6-a440-30ffe7b9f016 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:15.513982 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-37c46136-a30a-47f6-a440-30ffe7b9f016 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:15.521563 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-37c46136-a30a-47f6-a440-30ffe7b9f016 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.165988 Jul 04 09:30:15.522625 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 509/1032] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:15 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:16.539682 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9d74e87e-554f-49e5-a92a-e0494d0ef707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:16.540328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9d74e87e-554f-49e5-a92a-e0494d0ef707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:16.546432 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d74e87e-554f-49e5-a92a-e0494d0ef707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:16.546889 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d74e87e-554f-49e5-a92a-e0494d0ef707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:16.547657 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d74e87e-554f-49e5-a92a-e0494d0ef707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:16.548098 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d74e87e-554f-49e5-a92a-e0494d0ef707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:16.677188 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9d74e87e-554f-49e5-a92a-e0494d0ef707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:16.684943 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9d74e87e-554f-49e5-a92a-e0494d0ef707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.149533 Jul 04 09:30:16.685536 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 524/1033] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:16 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:17.704413 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ef832c9b-6ca0-4db6-bb4c-14d1f10a4d3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:17.704972 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ef832c9b-6ca0-4db6-bb4c-14d1f10a4d3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:17.711574 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef832c9b-6ca0-4db6-bb4c-14d1f10a4d3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:17.712634 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef832c9b-6ca0-4db6-bb4c-14d1f10a4d3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:17.713533 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef832c9b-6ca0-4db6-bb4c-14d1f10a4d3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:17.713991 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ef832c9b-6ca0-4db6-bb4c-14d1f10a4d3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:17.842403 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-ef832c9b-6ca0-4db6-bb4c-14d1f10a4d3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:17.850156 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ef832c9b-6ca0-4db6-bb4c-14d1f10a4d3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.150544 Jul 04 09:30:17.850712 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 510/1034] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:17 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:30:18.920049 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0c8d1689-d11f-41ee-94e6-e4581d69472b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:18.920652 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0c8d1689-d11f-41ee-94e6-e4581d69472b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:18.927257 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c8d1689-d11f-41ee-94e6-e4581d69472b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:18.927716 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c8d1689-d11f-41ee-94e6-e4581d69472b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:18.928485 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c8d1689-d11f-41ee-94e6-e4581d69472b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:18.928927 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0c8d1689-d11f-41ee-94e6-e4581d69472b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:19.062813 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-0c8d1689-d11f-41ee-94e6-e4581d69472b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:19.070328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0c8d1689-d11f-41ee-94e6-e4581d69472b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.154219 Jul 04 09:30:19.070883 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 525/1035] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:18 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:20.088724 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-26675a87-7adb-4d82-a23d-9d008477add1 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:20.089366 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-26675a87-7adb-4d82-a23d-9d008477add1 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:20.095985 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26675a87-7adb-4d82-a23d-9d008477add1 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:20.096697 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26675a87-7adb-4d82-a23d-9d008477add1 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:20.097599 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26675a87-7adb-4d82-a23d-9d008477add1 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:20.098047 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-26675a87-7adb-4d82-a23d-9d008477add1 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:20.227016 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-26675a87-7adb-4d82-a23d-9d008477add1 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:20.235637 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-26675a87-7adb-4d82-a23d-9d008477add1 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.151054 Jul 04 09:30:20.236204 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 511/1036] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:20 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:21.253980 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3e6f2af1-40f9-45bc-8f78-1b85753c1e5f tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:21.254622 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3e6f2af1-40f9-45bc-8f78-1b85753c1e5f tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:21.261926 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e6f2af1-40f9-45bc-8f78-1b85753c1e5f tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:21.262384 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e6f2af1-40f9-45bc-8f78-1b85753c1e5f tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:21.263154 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e6f2af1-40f9-45bc-8f78-1b85753c1e5f tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:21.263651 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3e6f2af1-40f9-45bc-8f78-1b85753c1e5f tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:21.399064 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3e6f2af1-40f9-45bc-8f78-1b85753c1e5f tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:21.406754 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3e6f2af1-40f9-45bc-8f78-1b85753c1e5f tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.156680 Jul 04 09:30:21.407317 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 526/1037] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:21 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:22.369949 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0bd56b65-6656-49a2-8767-e6239adc0095 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:22.370566 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0bd56b65-6656-49a2-8767-e6239adc0095 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:22.377067 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bd56b65-6656-49a2-8767-e6239adc0095 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:22.377541 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bd56b65-6656-49a2-8767-e6239adc0095 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:22.378325 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bd56b65-6656-49a2-8767-e6239adc0095 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:22.378770 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0bd56b65-6656-49a2-8767-e6239adc0095 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:22.409145 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0bd56b65-6656-49a2-8767-e6239adc0095 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:30:22.423665 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-88e7ff1f-70fd-4176-b141-ed8ddb916d97 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:22.424451 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-88e7ff1f-70fd-4176-b141-ed8ddb916d97 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:22.430943 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-88e7ff1f-70fd-4176-b141-ed8ddb916d97 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:22.431999 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-88e7ff1f-70fd-4176-b141-ed8ddb916d97 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:22.432945 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-88e7ff1f-70fd-4176-b141-ed8ddb916d97 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:22.433407 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-88e7ff1f-70fd-4176-b141-ed8ddb916d97 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:22.487228 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0bd56b65-6656-49a2-8767-e6239adc0095 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 204 len: 0 microversion: 2.1 time: 0.120862 Jul 04 09:30:22.487824 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 512/1038] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:30:22 2022] DELETE /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:30:22.498641 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-f9cb6fc7-6dd0-463e-8647-a8f385c0f05a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:22.499351 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-f9cb6fc7-6dd0-463e-8647-a8f385c0f05a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:22.506131 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f9cb6fc7-6dd0-463e-8647-a8f385c0f05a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:22.506591 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f9cb6fc7-6dd0-463e-8647-a8f385c0f05a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:22.507368 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f9cb6fc7-6dd0-463e-8647-a8f385c0f05a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:22.507811 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-f9cb6fc7-6dd0-463e-8647-a8f385c0f05a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:22.616595 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-88e7ff1f-70fd-4176-b141-ed8ddb916d97 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:22.625355 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-88e7ff1f-70fd-4176-b141-ed8ddb916d97 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1509 microversion: 2.1 time: 0.205407 Jul 04 09:30:22.625969 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 527/1039] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:22 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:30:22.641553 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6a5f8002-3dc3-4274-bbbd-a7a2e5cdd165 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:30:22.642126 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6a5f8002-3dc3-4274-bbbd-a7a2e5cdd165 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:22.648009 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a5f8002-3dc3-4274-bbbd-a7a2e5cdd165 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:22.648465 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a5f8002-3dc3-4274-bbbd-a7a2e5cdd165 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:22.649267 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a5f8002-3dc3-4274-bbbd-a7a2e5cdd165 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:22.649713 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-6a5f8002-3dc3-4274-bbbd-a7a2e5cdd165 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:22.666140 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-f9cb6fc7-6dd0-463e-8647-a8f385c0f05a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:22.674111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-f9cb6fc7-6dd0-463e-8647-a8f385c0f05a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1576 microversion: 2.1 time: 0.180544 Jul 04 09:30:22.674674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 513/1040] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:22 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:22.739095 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6a5f8002-3dc3-4274-bbbd-a7a2e5cdd165 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "POST /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87/action" status: 202 len: 0 microversion: 2.1 time: 0.101233 Jul 04 09:30:22.739824 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 528/1041] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 4 09:30:22 2022] POST /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 09:30:22.748594 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0b732bea-3799-4df5-a092-e2b092b37655 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:22.749263 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0b732bea-3799-4df5-a092-e2b092b37655 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:22.755258 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b732bea-3799-4df5-a092-e2b092b37655 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:22.755724 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b732bea-3799-4df5-a092-e2b092b37655 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:22.756520 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b732bea-3799-4df5-a092-e2b092b37655 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:22.756953 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b732bea-3799-4df5-a092-e2b092b37655 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:22.897943 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-0b732bea-3799-4df5-a092-e2b092b37655 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:22.906371 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0b732bea-3799-4df5-a092-e2b092b37655 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1517 microversion: 2.1 time: 0.161822 Jul 04 09:30:22.906940 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 514/1042] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:22 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:30:23.692236 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a9f7e92a-a0eb-4cf1-8c95-1910b8cb8a6b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:23.692786 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a9f7e92a-a0eb-4cf1-8c95-1910b8cb8a6b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:23.701982 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9f7e92a-a0eb-4cf1-8c95-1910b8cb8a6b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:23.702446 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9f7e92a-a0eb-4cf1-8c95-1910b8cb8a6b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:23.703218 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9f7e92a-a0eb-4cf1-8c95-1910b8cb8a6b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:23.703664 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a9f7e92a-a0eb-4cf1-8c95-1910b8cb8a6b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:23.840735 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-a9f7e92a-a0eb-4cf1-8c95-1910b8cb8a6b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:23.849434 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a9f7e92a-a0eb-4cf1-8c95-1910b8cb8a6b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1576 microversion: 2.1 time: 0.161599 Jul 04 09:30:23.850004 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 529/1043] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:23 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:23.923998 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-1c2b1a87-9213-4959-aca7-56ab7bf7ea67 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:23.924641 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-1c2b1a87-9213-4959-aca7-56ab7bf7ea67 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:23.931899 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c2b1a87-9213-4959-aca7-56ab7bf7ea67 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:23.932471 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c2b1a87-9213-4959-aca7-56ab7bf7ea67 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:23.933274 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c2b1a87-9213-4959-aca7-56ab7bf7ea67 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:23.933717 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-1c2b1a87-9213-4959-aca7-56ab7bf7ea67 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:24.068176 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-1c2b1a87-9213-4959-aca7-56ab7bf7ea67 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:24.076463 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-1c2b1a87-9213-4959-aca7-56ab7bf7ea67 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1519 microversion: 2.1 time: 0.156350 Jul 04 09:30:24.077030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 515/1044] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:23 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:24.867296 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-23d937f3-3922-43fc-810d-0f3749707077 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:24.867861 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-23d937f3-3922-43fc-810d-0f3749707077 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:24.875386 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-23d937f3-3922-43fc-810d-0f3749707077 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:24.875852 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-23d937f3-3922-43fc-810d-0f3749707077 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:24.876648 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-23d937f3-3922-43fc-810d-0f3749707077 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:24.877116 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-23d937f3-3922-43fc-810d-0f3749707077 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:24.952527 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-23d937f3-3922-43fc-810d-0f3749707077 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:24.965414 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-23d937f3-3922-43fc-810d-0f3749707077 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1509 microversion: 2.1 time: 0.101901 Jul 04 09:30:24.966698 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 530/1045] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:24 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1509 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:25.094249 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-486c8043-e411-415f-b83a-0ff9d1ad7d21 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:25.094876 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-486c8043-e411-415f-b83a-0ff9d1ad7d21 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:25.101502 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-486c8043-e411-415f-b83a-0ff9d1ad7d21 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:25.102220 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-486c8043-e411-415f-b83a-0ff9d1ad7d21 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:25.103743 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-486c8043-e411-415f-b83a-0ff9d1ad7d21 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:25.104361 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-486c8043-e411-415f-b83a-0ff9d1ad7d21 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:25.155687 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-b7833cd6-45dd-461e-b137-ef6554915638 req-07ce811a-9dc2-428c-8622-b42a9534afbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274513ec-6bf9-4de3-98fb-11dca1f77a87", "name": "network-vif-unplugged", "status": "completed", "tag": "8276b6bb-88db-41f8-9062-1b0f0ac7e174"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:30:25.164678 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-b7833cd6-45dd-461e-b137-ef6554915638 req-07ce811a-9dc2-428c-8622-b42a9534afbd service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:25.165088 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-b7833cd6-45dd-461e-b137-ef6554915638 req-07ce811a-9dc2-428c-8622-b42a9534afbd service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:25.177379 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-b7833cd6-45dd-461e-b137-ef6554915638 req-07ce811a-9dc2-428c-8622-b42a9534afbd service nova] Creating event network-vif-unplugged:8276b6bb-88db-41f8-9062-1b0f0ac7e174 for instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 on hv-cinder-84456 Jul 04 09:30:25.182365 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-b7833cd6-45dd-461e-b137-ef6554915638 req-07ce811a-9dc2-428c-8622-b42a9534afbd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133378 Jul 04 09:30:25.182961 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 516/1046] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:30:25.250035 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-486c8043-e411-415f-b83a-0ff9d1ad7d21 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:25.257526 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-486c8043-e411-415f-b83a-0ff9d1ad7d21 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1575 microversion: 2.1 time: 0.167124 Jul 04 09:30:25.258327 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 531/1047] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:25 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:30:25.445077 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-baabf2ce-1093-4948-91b3-930dde2de5b0 req-fc971ecd-c27d-4c3f-bae6-a067028eece7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee3a79da-9564-4eed-8be7-970da53166b0", "name": "network-vif-deleted", "tag": "fbc8dd71-f265-41b0-a1b2-2c772fb0242d"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:30:25.456672 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-baabf2ce-1093-4948-91b3-930dde2de5b0 req-fc971ecd-c27d-4c3f-bae6-a067028eece7 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:25.457485 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-baabf2ce-1093-4948-91b3-930dde2de5b0 req-fc971ecd-c27d-4c3f-bae6-a067028eece7 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:25.470002 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-baabf2ce-1093-4948-91b3-930dde2de5b0 req-fc971ecd-c27d-4c3f-bae6-a067028eece7 service nova] Creating event network-vif-deleted:fbc8dd71-f265-41b0-a1b2-2c772fb0242d for instance ee3a79da-9564-4eed-8be7-970da53166b0 on hv-cinder-84456 Jul 04 09:30:25.475385 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-baabf2ce-1093-4948-91b3-930dde2de5b0 req-fc971ecd-c27d-4c3f-bae6-a067028eece7 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113483 Jul 04 09:30:25.476349 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 517/1048] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:30:25.982862 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:25.983619 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:25.990870 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:25.991328 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:25.992115 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:25.992588 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:26.025958 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:26.026413 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:26.026873 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lazy-loading 'fault' on Instance uuid ee3a79da-9564-4eed-8be7-970da53166b0 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:30:26.068780 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:26.077242 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b4cfa1bc-6ff9-44da-9b47-d47812acc27b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 200 len: 1230 microversion: 2.1 time: 0.098229 Jul 04 09:30:26.077821 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 532/1049] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:25 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:26.277013 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7a093b63-1bfb-42d9-9c11-4d6bd84c4707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:26.277743 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7a093b63-1bfb-42d9-9c11-4d6bd84c4707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:26.283943 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a093b63-1bfb-42d9-9c11-4d6bd84c4707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:26.284400 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a093b63-1bfb-42d9-9c11-4d6bd84c4707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:26.285233 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a093b63-1bfb-42d9-9c11-4d6bd84c4707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:26.285673 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7a093b63-1bfb-42d9-9c11-4d6bd84c4707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:26.422965 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7a093b63-1bfb-42d9-9c11-4d6bd84c4707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:26.430617 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7a093b63-1bfb-42d9-9c11-4d6bd84c4707 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1575 microversion: 2.1 time: 0.158648 Jul 04 09:30:26.431920 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 518/1050] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:26 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:27.094248 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-42ce2126-e8eb-4a26-b432-ef429bbe223a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:27.094866 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-42ce2126-e8eb-4a26-b432-ef429bbe223a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:27.101699 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-42ce2126-e8eb-4a26-b432-ef429bbe223a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:27.102153 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-42ce2126-e8eb-4a26-b432-ef429bbe223a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:27.103499 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-42ce2126-e8eb-4a26-b432-ef429bbe223a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:27.103939 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-42ce2126-e8eb-4a26-b432-ef429bbe223a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:27.116986 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-42ce2126-e8eb-4a26-b432-ef429bbe223a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] HTTP exception thrown: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-42ce2126-e8eb-4a26-b432-ef429bbe223a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Request method failure captured: Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 HTTP/1.1 Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrKNVeWn0iaQ7wj-WY173DlLrmxKpwMjXsnF8ELOykl559wLT0wlKW7g86KGKxrcG1W4L-qfi0rxyWei6xFSsFFKbIBBPDDSaDYdqenIns4mAtOeY_WNIMIgJEKcTkVLO4M1HWf9jWSHeM-sFTE5fba_RqnM4jgyP0ZoUqXJ7ALmuwA Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 4fe236d825ae40f793bf2a5bccedc3cd Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:30:27.119244 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_4fe236d825ae40f793bf2a5bccedc3cd", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 4fe236d825ae40f793bf2a5bccedc3cd Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-TestVolumeBootPattern-1296990484-project Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 70733d7f6b8b42a39425ebc94e1ec1f4 Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-TestVolumeBootPattern-1296990484-project Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:30:27.120998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': 'ee3a79da-9564-4eed-8be7-970da53166b0'} Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:30:27.121991 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:30:27.123347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:30:27.124645 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-42ce2126-e8eb-4a26-b432-ef429bbe223a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Returning 404 to user: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:30:27.124645 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-42ce2126-e8eb-4a26-b432-ef429bbe223a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 404 len: 111 microversion: 2.1 time: 0.030287 Jul 04 09:30:27.124645 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 533/1051] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:27 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:30:27.217301 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-386491274", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1745159673", "security_groups": [{"name": "tempest-secgroup-smoke-293614396"}], "block_device_mapping_v2": [{"uuid": "a0ce61cf-6aa4-42bc-8a7b-364a1a6a258c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ee02fb8-6fb5-48a7-85e0-025a20abf3c8"}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:30:27.331824 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] validate_networks() for [('3ee02fb8-6fb5-48a7-85e0-025a20abf3c8', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:30:27.449406 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ffc8c8c6-20a4-4980-a83c-5822bc8aeb4c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:27.450068 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ffc8c8c6-20a4-4980-a83c-5822bc8aeb4c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:27.456402 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffc8c8c6-20a4-4980-a83c-5822bc8aeb4c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:27.456861 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffc8c8c6-20a4-4980-a83c-5822bc8aeb4c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:27.457681 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffc8c8c6-20a4-4980-a83c-5822bc8aeb4c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:27.458121 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ffc8c8c6-20a4-4980-a83c-5822bc8aeb4c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:27.752314 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ffc8c8c6-20a4-4980-a83c-5822bc8aeb4c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:27.761534 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ffc8c8c6-20a4-4980-a83c-5822bc8aeb4c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1575 microversion: 2.1 time: 0.317455 Jul 04 09:30:27.762116 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 534/1052] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:27 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1575 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:30:28.041706 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:30:28.042140 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:30:28.042656 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:30:28.043081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:30:28.043502 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:30:28.053468 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:28.053919 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:28.054721 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:28.055157 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:28.072323 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Getting quotas for project 4fe236d825ae40f793bf2a5bccedc3cd. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:30:28.076491 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Getting quotas for user 70733d7f6b8b42a39425ebc94e1ec1f4 and project 4fe236d825ae40f793bf2a5bccedc3cd. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:30:28.134972 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:30:28.137161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0ce61cf-6aa4-42bc-8a7b-364a1a6a258c',volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:30:28.267653 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-4ffa17d2-f484-4276-a7a6-e628c2594695 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.054323 Jul 04 09:30:28.268293 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 519/1053] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:30:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:30:28.279912 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-359b8ba0-6172-44b3-a60c-010f9377e4e1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:28.280555 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-359b8ba0-6172-44b3-a60c-010f9377e4e1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:28.339427 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-359b8ba0-6172-44b3-a60c-010f9377e4e1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:28.346826 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-359b8ba0-6172-44b3-a60c-010f9377e4e1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1094 microversion: 2.1 time: 0.072382 Jul 04 09:30:28.348231 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 535/1054] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:28 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:30:28.778148 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-56de7fb7-82c0-4a94-9e7d-8187f738543c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:28.778873 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-56de7fb7-82c0-4a94-9e7d-8187f738543c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:28.786103 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56de7fb7-82c0-4a94-9e7d-8187f738543c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:28.786660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56de7fb7-82c0-4a94-9e7d-8187f738543c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:28.787441 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56de7fb7-82c0-4a94-9e7d-8187f738543c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:28.787882 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-56de7fb7-82c0-4a94-9e7d-8187f738543c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:28.928015 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-56de7fb7-82c0-4a94-9e7d-8187f738543c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:28.932061 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:28.936943 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-56de7fb7-82c0-4a94-9e7d-8187f738543c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1575 microversion: 2.1 time: 0.162876 Jul 04 09:30:28.937536 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 520/1055] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:28 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:29.364460 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-dbf2cb85-2133-49b4-a7c8-a0f4205f27dc tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:29.365313 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-dbf2cb85-2133-49b4-a7c8-a0f4205f27dc tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:29.373495 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dbf2cb85-2133-49b4-a7c8-a0f4205f27dc tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:29.374045 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dbf2cb85-2133-49b4-a7c8-a0f4205f27dc tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:29.374905 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dbf2cb85-2133-49b4-a7c8-a0f4205f27dc tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:29.375356 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-dbf2cb85-2133-49b4-a7c8-a0f4205f27dc tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:29.437967 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-dbf2cb85-2133-49b4-a7c8-a0f4205f27dc tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:29.451436 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-dbf2cb85-2133-49b4-a7c8-a0f4205f27dc tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1210 microversion: 2.1 time: 0.090533 Jul 04 09:30:29.452142 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 536/1056] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:29 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:29.956221 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-7c7bb968-cc5e-4cab-8221-b7e739fd3f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:29.956981 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-7c7bb968-cc5e-4cab-8221-b7e739fd3f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:29.967433 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c7bb968-cc5e-4cab-8221-b7e739fd3f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:29.968148 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c7bb968-cc5e-4cab-8221-b7e739fd3f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:29.969146 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c7bb968-cc5e-4cab-8221-b7e739fd3f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:29.969775 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-7c7bb968-cc5e-4cab-8221-b7e739fd3f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:30.111307 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-7c7bb968-cc5e-4cab-8221-b7e739fd3f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:30.119674 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-7c7bb968-cc5e-4cab-8221-b7e739fd3f3a tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1575 microversion: 2.1 time: 0.168533 Jul 04 09:30:30.120249 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 521/1057] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:29 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:30.469070 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-30b6d766-d07d-40f1-98fe-168f84e057ed tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:30.470092 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-30b6d766-d07d-40f1-98fe-168f84e057ed tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:30.479284 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30b6d766-d07d-40f1-98fe-168f84e057ed tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:30.479965 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30b6d766-d07d-40f1-98fe-168f84e057ed tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:30.481020 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30b6d766-d07d-40f1-98fe-168f84e057ed tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:30.481685 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-30b6d766-d07d-40f1-98fe-168f84e057ed tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:30.576725 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-0bd9ef06-c4c9-47cb-b392-d57fff552e15 req-657a829b-4915-473b-ad2a-31c196cef425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f135b80-2a92-4714-812f-5692ed1bc5f7", "tag": "81e35a72-e596-4281-9d19-1c373585ceeb"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:30:30.592303 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-0bd9ef06-c4c9-47cb-b392-d57fff552e15 req-657a829b-4915-473b-ad2a-31c196cef425 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:30.593063 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-0bd9ef06-c4c9-47cb-b392-d57fff552e15 req-657a829b-4915-473b-ad2a-31c196cef425 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:30.608296 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-0bd9ef06-c4c9-47cb-b392-d57fff552e15 req-657a829b-4915-473b-ad2a-31c196cef425 service nova] Creating event network-changed:81e35a72-e596-4281-9d19-1c373585ceeb for instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 on hv-cinder-84456 Jul 04 09:30:30.615935 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-0bd9ef06-c4c9-47cb-b392-d57fff552e15 req-657a829b-4915-473b-ad2a-31c196cef425 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042776 Jul 04 09:30:30.616903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 522/1058] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:30:30.660347 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-30b6d766-d07d-40f1-98fe-168f84e057ed tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:30.663992 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:30.672047 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-30b6d766-d07d-40f1-98fe-168f84e057ed tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1265 microversion: 2.1 time: 0.206872 Jul 04 09:30:30.673277 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 537/1059] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:30 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:31.138188 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-48f03976-b1d1-4ff7-8b05-8d51bf543f8b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:31.138884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-48f03976-b1d1-4ff7-8b05-8d51bf543f8b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:31.145530 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48f03976-b1d1-4ff7-8b05-8d51bf543f8b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:31.145975 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48f03976-b1d1-4ff7-8b05-8d51bf543f8b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:31.146929 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48f03976-b1d1-4ff7-8b05-8d51bf543f8b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:31.147528 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-48f03976-b1d1-4ff7-8b05-8d51bf543f8b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:31.292275 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-48f03976-b1d1-4ff7-8b05-8d51bf543f8b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:31.300424 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-48f03976-b1d1-4ff7-8b05-8d51bf543f8b tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1575 microversion: 2.1 time: 0.166934 Jul 04 09:30:31.300991 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 523/1060] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:31 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:31.690007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-44c8af30-b79f-4b23-9231-ea50b4cd7dc4 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:31.690639 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-44c8af30-b79f-4b23-9231-ea50b4cd7dc4 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:31.700749 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-44c8af30-b79f-4b23-9231-ea50b4cd7dc4 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:31.701257 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-44c8af30-b79f-4b23-9231-ea50b4cd7dc4 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:31.702038 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-44c8af30-b79f-4b23-9231-ea50b4cd7dc4 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:31.702479 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-44c8af30-b79f-4b23-9231-ea50b4cd7dc4 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:31.846752 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-44c8af30-b79f-4b23-9231-ea50b4cd7dc4 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:31.856040 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-44c8af30-b79f-4b23-9231-ea50b4cd7dc4 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1265 microversion: 2.1 time: 0.170340 Jul 04 09:30:31.857709 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 538/1061] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:31 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:32.317929 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-13516ff8-a2ac-4ce2-9b26-eddbc0762def tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:32.318544 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-13516ff8-a2ac-4ce2-9b26-eddbc0762def tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:32.325769 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13516ff8-a2ac-4ce2-9b26-eddbc0762def tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:32.326234 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13516ff8-a2ac-4ce2-9b26-eddbc0762def tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:32.327034 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13516ff8-a2ac-4ce2-9b26-eddbc0762def tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:32.327459 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-13516ff8-a2ac-4ce2-9b26-eddbc0762def tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:32.497677 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-13516ff8-a2ac-4ce2-9b26-eddbc0762def tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:32.505721 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-13516ff8-a2ac-4ce2-9b26-eddbc0762def tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1575 microversion: 2.1 time: 0.191678 Jul 04 09:30:32.506802 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 524/1062] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:32 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:32.875319 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-9d201006-169e-4dfd-851c-d4bbd4176dfa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:32.875947 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-9d201006-169e-4dfd-851c-d4bbd4176dfa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:32.882273 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d201006-169e-4dfd-851c-d4bbd4176dfa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:32.882735 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d201006-169e-4dfd-851c-d4bbd4176dfa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:32.883520 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d201006-169e-4dfd-851c-d4bbd4176dfa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:32.883963 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-9d201006-169e-4dfd-851c-d4bbd4176dfa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:33.048517 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-9d201006-169e-4dfd-851c-d4bbd4176dfa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:33.057812 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-9d201006-169e-4dfd-851c-d4bbd4176dfa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1265 microversion: 2.1 time: 0.186999 Jul 04 09:30:33.061234 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 539/1063] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:32 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:33.524032 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8b788201-0b7c-4590-a777-eaec029b39e7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:33.524729 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8b788201-0b7c-4590-a777-eaec029b39e7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:33.531345 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b788201-0b7c-4590-a777-eaec029b39e7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:33.531798 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b788201-0b7c-4590-a777-eaec029b39e7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:33.532791 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b788201-0b7c-4590-a777-eaec029b39e7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:33.533287 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b788201-0b7c-4590-a777-eaec029b39e7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:33.671656 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8b788201-0b7c-4590-a777-eaec029b39e7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:33.679754 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8b788201-0b7c-4590-a777-eaec029b39e7 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1575 microversion: 2.1 time: 0.159767 Jul 04 09:30:33.681166 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 525/1064] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:33 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:34.075133 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-98224bc5-a620-4f94-815f-16acb6566d20 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:34.075802 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-98224bc5-a620-4f94-815f-16acb6566d20 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:34.083314 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98224bc5-a620-4f94-815f-16acb6566d20 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:34.083764 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98224bc5-a620-4f94-815f-16acb6566d20 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:34.084542 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98224bc5-a620-4f94-815f-16acb6566d20 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:34.085023 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-98224bc5-a620-4f94-815f-16acb6566d20 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:34.228524 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-98224bc5-a620-4f94-815f-16acb6566d20 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:34.236447 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-98224bc5-a620-4f94-815f-16acb6566d20 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1265 microversion: 2.1 time: 0.165627 Jul 04 09:30:34.237003 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 540/1065] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:34 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:34.698680 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-28298b33-e0c1-455d-8303-ce337c256213 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:34.699585 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-28298b33-e0c1-455d-8303-ce337c256213 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:34.707849 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-28298b33-e0c1-455d-8303-ce337c256213 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:34.708679 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-28298b33-e0c1-455d-8303-ce337c256213 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:34.709761 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-28298b33-e0c1-455d-8303-ce337c256213 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:34.710577 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-28298b33-e0c1-455d-8303-ce337c256213 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:34.850125 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-28298b33-e0c1-455d-8303-ce337c256213 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:34.860108 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-28298b33-e0c1-455d-8303-ce337c256213 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1562 microversion: 2.1 time: 0.165202 Jul 04 09:30:34.860695 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 526/1066] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:34 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:35.253309 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f10c480b-e740-406e-b12d-027db089f0c3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:35.256455 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f10c480b-e740-406e-b12d-027db089f0c3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:35.264097 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f10c480b-e740-406e-b12d-027db089f0c3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:35.264550 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f10c480b-e740-406e-b12d-027db089f0c3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:35.265569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f10c480b-e740-406e-b12d-027db089f0c3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:35.266185 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f10c480b-e740-406e-b12d-027db089f0c3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:35.361140 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-e54cd596-803a-47af-baaf-cc0408eda429 req-6ef01a0d-eb43-4036-b0cb-c9802cd67130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274513ec-6bf9-4de3-98fb-11dca1f77a87", "name": "network-vif-plugged", "status": "completed", "tag": "8276b6bb-88db-41f8-9062-1b0f0ac7e174"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:30:35.373359 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e54cd596-803a-47af-baaf-cc0408eda429 req-6ef01a0d-eb43-4036-b0cb-c9802cd67130 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:35.373359 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-e54cd596-803a-47af-baaf-cc0408eda429 req-6ef01a0d-eb43-4036-b0cb-c9802cd67130 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:35.387648 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-e54cd596-803a-47af-baaf-cc0408eda429 req-6ef01a0d-eb43-4036-b0cb-c9802cd67130 service nova] Creating event network-vif-plugged:8276b6bb-88db-41f8-9062-1b0f0ac7e174 for instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 on hv-cinder-84456 Jul 04 09:30:35.403105 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-e54cd596-803a-47af-baaf-cc0408eda429 req-6ef01a0d-eb43-4036-b0cb-c9802cd67130 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043826 Jul 04 09:30:35.403752 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 527/1067] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:30:35.427282 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f10c480b-e740-406e-b12d-027db089f0c3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:35.436919 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f10c480b-e740-406e-b12d-027db089f0c3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1265 microversion: 2.1 time: 0.187578 Jul 04 09:30:35.437585 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 541/1068] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:35 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:36.454883 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-261eb68e-a542-43f3-afee-2b0154adc249 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:36.455588 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-261eb68e-a542-43f3-afee-2b0154adc249 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:36.462384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-261eb68e-a542-43f3-afee-2b0154adc249 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:36.462842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-261eb68e-a542-43f3-afee-2b0154adc249 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:36.463625 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-261eb68e-a542-43f3-afee-2b0154adc249 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:36.464071 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-261eb68e-a542-43f3-afee-2b0154adc249 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:36.609671 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-261eb68e-a542-43f3-afee-2b0154adc249 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:36.617308 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-261eb68e-a542-43f3-afee-2b0154adc249 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1265 microversion: 2.1 time: 0.167077 Jul 04 09:30:36.620809 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 528/1069] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:36 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:30:37.425149 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-a1a71e96-bdf6-457c-9c63-ba8042b1fabd req-408e8fcf-8675-4b17-b2e1-82ba6e953001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f135b80-2a92-4714-812f-5692ed1bc5f7", "name": "network-vif-plugged", "status": "completed", "tag": "81e35a72-e596-4281-9d19-1c373585ceeb"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:30:37.434718 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-a1a71e96-bdf6-457c-9c63-ba8042b1fabd req-408e8fcf-8675-4b17-b2e1-82ba6e953001 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:37.435173 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-a1a71e96-bdf6-457c-9c63-ba8042b1fabd req-408e8fcf-8675-4b17-b2e1-82ba6e953001 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:37.446496 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-a1a71e96-bdf6-457c-9c63-ba8042b1fabd req-408e8fcf-8675-4b17-b2e1-82ba6e953001 service nova] Creating event network-vif-plugged:81e35a72-e596-4281-9d19-1c373585ceeb for instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 on hv-cinder-84456 Jul 04 09:30:37.451655 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-a1a71e96-bdf6-457c-9c63-ba8042b1fabd req-408e8fcf-8675-4b17-b2e1-82ba6e953001 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030246 Jul 04 09:30:37.452636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 542/1070] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:30:37.635378 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-fda9013c-9c5e-4e84-8b61-127acf9bbb50 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:37.636384 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-fda9013c-9c5e-4e84-8b61-127acf9bbb50 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:37.643715 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fda9013c-9c5e-4e84-8b61-127acf9bbb50 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:37.644175 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fda9013c-9c5e-4e84-8b61-127acf9bbb50 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:37.645017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fda9013c-9c5e-4e84-8b61-127acf9bbb50 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:37.645657 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-fda9013c-9c5e-4e84-8b61-127acf9bbb50 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:37.782469 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-fda9013c-9c5e-4e84-8b61-127acf9bbb50 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:37.790799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-fda9013c-9c5e-4e84-8b61-127acf9bbb50 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1265 microversion: 2.1 time: 0.160057 Jul 04 09:30:37.791394 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 529/1071] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:37 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:38.805477 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:38.810730 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-8e9e652f-56eb-4586-aa3f-f9e04cc38435 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:38.811440 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-8e9e652f-56eb-4586-aa3f-f9e04cc38435 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:38.818086 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e9e652f-56eb-4586-aa3f-f9e04cc38435 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:38.818545 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e9e652f-56eb-4586-aa3f-f9e04cc38435 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:38.819316 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e9e652f-56eb-4586-aa3f-f9e04cc38435 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:38.819762 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-8e9e652f-56eb-4586-aa3f-f9e04cc38435 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:38.955612 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-8e9e652f-56eb-4586-aa3f-f9e04cc38435 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:38.963786 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-8e9e652f-56eb-4586-aa3f-f9e04cc38435 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1451 microversion: 2.1 time: 0.159921 Jul 04 09:30:38.972818 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 543/1072] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:38 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:38.980825 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-8b2de244-7239-4984-8834-7cd87141002d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:30:38.981428 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-8b2de244-7239-4984-8834-7cd87141002d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:30:38.983400 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:38.984064 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:38.990872 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b2de244-7239-4984-8834-7cd87141002d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:38.991330 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b2de244-7239-4984-8834-7cd87141002d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:38.992846 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b2de244-7239-4984-8834-7cd87141002d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:38.993545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-8b2de244-7239-4984-8834-7cd87141002d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:39.127844 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-8b2de244-7239-4984-8834-7cd87141002d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:30:39.139034 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-8b2de244-7239-4984-8834-7cd87141002d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1451 microversion: 2.1 time: 0.162943 Jul 04 09:30:39.139660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 530/1073] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:30:38 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:30:40.757974 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-83cf60dd-0e8f-432a-a5ea-bddec8a7ba8a req-96ddb41f-5861-43d9-97f5-28ab67c8e0ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f135b80-2a92-4714-812f-5692ed1bc5f7", "tag": "81e35a72-e596-4281-9d19-1c373585ceeb"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:30:40.761833 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=53 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:30:40.767917 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-83cf60dd-0e8f-432a-a5ea-bddec8a7ba8a req-96ddb41f-5861-43d9-97f5-28ab67c8e0ea service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:30:40.768374 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-83cf60dd-0e8f-432a-a5ea-bddec8a7ba8a req-96ddb41f-5861-43d9-97f5-28ab67c8e0ea service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:30:40.782618 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-83cf60dd-0e8f-432a-a5ea-bddec8a7ba8a req-96ddb41f-5861-43d9-97f5-28ab67c8e0ea service nova] Creating event network-changed:81e35a72-e596-4281-9d19-1c373585ceeb for instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 on hv-cinder-84456 Jul 04 09:30:40.787496 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-83cf60dd-0e8f-432a-a5ea-bddec8a7ba8a req-96ddb41f-5861-43d9-97f5-28ab67c8e0ea service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033216 Jul 04 09:30:40.788129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 544/1074] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:30:53.651494 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:30:53.652029 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Mon Jul 4 09:30:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:31:51.455838 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:51.457004 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=52 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:51.460129 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:51.461230 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=34 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:31:51.461907 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-0b860f70-e19f-44a8-ae02-d4b964f9e49e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:31:51.462510 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0b860f70-e19f-44a8-ae02-d4b964f9e49e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:31:51.470976 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b860f70-e19f-44a8-ae02-d4b964f9e49e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:51.471528 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b860f70-e19f-44a8-ae02-d4b964f9e49e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:51.472412 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b860f70-e19f-44a8-ae02-d4b964f9e49e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:51.472990 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-0b860f70-e19f-44a8-ae02-d4b964f9e49e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:51.501820 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-0b860f70-e19f-44a8-ae02-d4b964f9e49e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Going to try to terminate instance {{(pid=117664) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:31:51.592855 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-0b860f70-e19f-44a8-ae02-d4b964f9e49e tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "DELETE /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 204 len: 0 microversion: 2.1 time: 0.138496 Jul 04 09:31:51.596539 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 531/1075] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:31:51 2022] DELETE /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:31:51.603652 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [req-baeec5d7-2bfa-45c3-8646-926284109410 req-60038e7c-7d8c-48e3-8e50-adbfba4f8b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274513ec-6bf9-4de3-98fb-11dca1f77a87", "tag": "8276b6bb-88db-41f8-9062-1b0f0ac7e174"}]} {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:31:51.605489 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-9d93bcb2-dd83-46dd-9ba1-da02460ab8df tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:31:51.606194 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-9d93bcb2-dd83-46dd-9ba1-da02460ab8df tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:31:51.612205 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d93bcb2-dd83-46dd-9ba1-da02460ab8df tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:51.612660 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d93bcb2-dd83-46dd-9ba1-da02460ab8df tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:51.613461 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d93bcb2-dd83-46dd-9ba1-da02460ab8df tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:51.613903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-9d93bcb2-dd83-46dd-9ba1-da02460ab8df tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:51.614047 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-baeec5d7-2bfa-45c3-8646-926284109410 req-60038e7c-7d8c-48e3-8e50-adbfba4f8b57 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:51.614411 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [req-baeec5d7-2bfa-45c3-8646-926284109410 req-60038e7c-7d8c-48e3-8e50-adbfba4f8b57 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:51.627034 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.compute.server_external_events [req-baeec5d7-2bfa-45c3-8646-926284109410 req-60038e7c-7d8c-48e3-8e50-adbfba4f8b57 service nova] Creating event network-changed:8276b6bb-88db-41f8-9062-1b0f0ac7e174 for instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 on hv-cinder-84456 Jul 04 09:31:51.633808 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [req-baeec5d7-2bfa-45c3-8646-926284109410 req-60038e7c-7d8c-48e3-8e50-adbfba4f8b57 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176811 Jul 04 09:31:51.634485 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 545/1076] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:31:51.751662 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-9d93bcb2-dd83-46dd-9ba1-da02460ab8df tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:31:51.759785 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-9d93bcb2-dd83-46dd-9ba1-da02460ab8df tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.158994 Jul 04 09:31:51.760344 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 532/1077] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:31:51 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:31:52.778743 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-e0cbb531-1b72-4196-ac39-9d6465f40d30 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:31:52.779434 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-e0cbb531-1b72-4196-ac39-9d6465f40d30 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:31:52.786188 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0cbb531-1b72-4196-ac39-9d6465f40d30 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:52.786633 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0cbb531-1b72-4196-ac39-9d6465f40d30 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:52.787401 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0cbb531-1b72-4196-ac39-9d6465f40d30 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:52.787837 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-e0cbb531-1b72-4196-ac39-9d6465f40d30 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:52.920951 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-e0cbb531-1b72-4196-ac39-9d6465f40d30 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:31:52.928551 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-e0cbb531-1b72-4196-ac39-9d6465f40d30 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1568 microversion: 2.1 time: 0.154279 Jul 04 09:31:52.929174 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 546/1078] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:31:52 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:31:53.726568 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-d46c0c31-9bbc-4b14-9fe0-73a685087c3d req-702e9761-376a-4040-b64f-b89c5de22dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274513ec-6bf9-4de3-98fb-11dca1f77a87", "name": "network-vif-deleted", "tag": "8276b6bb-88db-41f8-9062-1b0f0ac7e174"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:31:53.735915 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-d46c0c31-9bbc-4b14-9fe0-73a685087c3d req-702e9761-376a-4040-b64f-b89c5de22dbf service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:53.736364 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-d46c0c31-9bbc-4b14-9fe0-73a685087c3d req-702e9761-376a-4040-b64f-b89c5de22dbf service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:53.750391 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-d46c0c31-9bbc-4b14-9fe0-73a685087c3d req-702e9761-376a-4040-b64f-b89c5de22dbf service nova] Creating event network-vif-deleted:8276b6bb-88db-41f8-9062-1b0f0ac7e174 for instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 on hv-cinder-84456 Jul 04 09:31:53.755185 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-d46c0c31-9bbc-4b14-9fe0-73a685087c3d req-702e9761-376a-4040-b64f-b89c5de22dbf service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032420 Jul 04 09:31:53.755777 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 533/1079] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:31:53.946416 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ea714a8a-1bf9-4f24-b1d8-bcebe2f2d588 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:31:53.946981 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ea714a8a-1bf9-4f24-b1d8-bcebe2f2d588 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:31:53.953640 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ea714a8a-1bf9-4f24-b1d8-bcebe2f2d588 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:53.954101 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ea714a8a-1bf9-4f24-b1d8-bcebe2f2d588 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:53.954885 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ea714a8a-1bf9-4f24-b1d8-bcebe2f2d588 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:53.955330 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ea714a8a-1bf9-4f24-b1d8-bcebe2f2d588 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:54.027461 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ea714a8a-1bf9-4f24-b1d8-bcebe2f2d588 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c3b8aef249b984bc907b1753747c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b9fbff141540f0858c09f7ea1e80b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:31:54.035948 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ea714a8a-1bf9-4f24-b1d8-bcebe2f2d588 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 200 len: 1218 microversion: 2.1 time: 0.094115 Jul 04 09:31:54.036518 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 547/1080] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:31:53 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:31:55.053895 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-747d61e1-461e-4baa-a559-f970a013d665 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:31:55.054593 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-747d61e1-461e-4baa-a559-f970a013d665 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] [instance: 274513ec-6bf9-4de3-98fb-11dca1f77a87] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:31:55.060765 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-747d61e1-461e-4baa-a559-f970a013d665 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:55.061250 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-747d61e1-461e-4baa-a559-f970a013d665 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:55.062013 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-747d61e1-461e-4baa-a559-f970a013d665 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:31:55.062455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-747d61e1-461e-4baa-a559-f970a013d665 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:31:55.075469 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-747d61e1-461e-4baa-a559-f970a013d665 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] HTTP exception thrown: Instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 could not be found. Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-747d61e1-461e-4baa-a559-f970a013d665 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Request method failure captured: Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 HTTP/1.1 Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrJ9KIEFk7LH5Lgyfp8KrnAro4Tmdl18WiO27k1S_BH_FxbvvD7ohCWfFQAscaFmmbGGKbafSkT7sb2S1Kf87dRKUdvGP6KVg-McEdECQzDpdLtEiXqNsU8qIUwfFwICMKhfVY7t6POffP1wqq78ALYl5efy-eQfqg-5e8X7ssNH_5s Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: a2b9fbff141540f0858c09f7ea1e80b9 Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestShelveInstance-947343434 Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:31:55.077081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a2b9fbff141540f0858c09f7ea1e80b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/a2b9fbff141540f0858c09f7ea1e80b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/a2b9fbff141540f0858c09f7ea1e80b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_a2b9fbff141540f0858c09f7ea1e80b9", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestShelveInstance-947343434 Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: a2b9fbff141540f0858c09f7ea1e80b9 Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestShelveInstance-947343434 Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-TestShelveInstance-947343434-project Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: df06c3b8aef249b984bc907b1753747c Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestShelveInstance-947343434-project Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 could not be found. Jul 04 09:31:55.078842 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '274513ec-6bf9-4de3-98fb-11dca1f77a87'} Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 could not be found. Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:31:55.079891 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 could not be found. Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 could not be found. Jul 04 09:31:55.081553 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:31:55.083086 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-747d61e1-461e-4baa-a559-f970a013d665 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Returning 404 to user: Instance 274513ec-6bf9-4de3-98fb-11dca1f77a87 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:31:55.083086 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-747d61e1-461e-4baa-a559-f970a013d665 tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87" status: 404 len: 111 microversion: 2.1 time: 0.029351 Jul 04 09:31:55.083086 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 534/1081] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:31:55 2022] GET /compute/v2.1/servers/274513ec-6bf9-4de3-98fb-11dca1f77a87 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:31:55.235761 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-5d09a3fa-dce8-4fec-af17-c1f0dda99f5c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] Calling method '.version_select at 0x7fad7acc2700>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:31:55.256434 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-5d09a3fa-dce8-4fec-af17-c1f0dda99f5c tempest-TestShelveInstance-947343434 tempest-TestShelveInstance-947343434-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-768617593" status: 202 len: 0 microversion: 2.1 time: 0.024984 Jul 04 09:31:55.258140 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 548/1082] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 4 09:31:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-768617593 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:32:19.439903 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1420374047", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1745159673", "security_groups": [{"name": "tempest-secgroup-smoke-293614396"}], "block_device_mapping_v2": [{"uuid": "30b7dc04-d899-4494-a33f-9d2e3da98f7d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ee02fb8-6fb5-48a7-85e0-025a20abf3c8"}]}} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:32:19.448608 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:19.449272 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:19.559995 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.network.neutron [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] validate_networks() for [('3ee02fb8-6fb5-48a7-85e0-025a20abf3c8', None, None, None, None, None)] {{(pid=117664) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 09:32:19.929954 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Flavor limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 09:32:19.930385 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Image limits 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 09:32:19.930864 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Flavor pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 09:32:19.931299 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Image pref 0:0:0 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 09:32:19.931717 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.virt.hardware [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 09:32:19.940482 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:19.940933 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:19.941779 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:19.942225 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:19.959289 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Getting quotas for project 4fe236d825ae40f793bf2a5bccedc3cd. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 09:32:19.963261 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.quota [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Getting quotas for user 70733d7f6b8b42a39425ebc94e1ec1f4 and project 4fe236d825ae40f793bf2a5bccedc3cd. Resources: {'instances', 'ram', 'cores'} {{(pid=117664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 09:32:20.019545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Going to run 1 instances... {{(pid=117664) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 09:32:20.021715 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30b7dc04-d899-4494-a33f-9d2e3da98f7d',volume_size=None,volume_type=None)] {{(pid=117664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 09:32:20.144951 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-ba662100-52c6-4e1b-904c-4c5ab4455e8e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.708833 Jul 04 09:32:20.145627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 535/1083] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 4 09:32:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 09:32:20.153863 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=14 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:20.154604 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:20.158438 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-6425ab3a-91ab-4870-a5fd-6027863571aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:20.159049 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-6425ab3a-91ab-4870-a5fd-6027863571aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:20.225007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-6425ab3a-91ab-4870-a5fd-6027863571aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:20.231814 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-6425ab3a-91ab-4870-a5fd-6027863571aa tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1095 microversion: 2.1 time: 0.079371 Jul 04 09:32:20.232529 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 549/1084] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:20 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:21.249751 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-dcafda3d-30d6-4b8f-af76-a8418301c173 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:21.250522 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-dcafda3d-30d6-4b8f-af76-a8418301c173 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:21.257474 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dcafda3d-30d6-4b8f-af76-a8418301c173 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:21.258006 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dcafda3d-30d6-4b8f-af76-a8418301c173 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:21.258855 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dcafda3d-30d6-4b8f-af76-a8418301c173 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:21.259386 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-dcafda3d-30d6-4b8f-af76-a8418301c173 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:21.330726 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-dcafda3d-30d6-4b8f-af76-a8418301c173 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:21.339317 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-dcafda3d-30d6-4b8f-af76-a8418301c173 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1211 microversion: 2.1 time: 0.093943 Jul 04 09:32:21.340111 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 536/1085] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:21 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:22.356150 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ca0d1754-e9bf-4418-93c4-88d4f9d89213 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:22.356797 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ca0d1754-e9bf-4418-93c4-88d4f9d89213 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:22.363750 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ca0d1754-e9bf-4418-93c4-88d4f9d89213 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:22.364246 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ca0d1754-e9bf-4418-93c4-88d4f9d89213 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:22.365964 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ca0d1754-e9bf-4418-93c4-88d4f9d89213 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:22.366647 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ca0d1754-e9bf-4418-93c4-88d4f9d89213 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:22.515257 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ca0d1754-e9bf-4418-93c4-88d4f9d89213 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:22.524567 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ca0d1754-e9bf-4418-93c4-88d4f9d89213 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.172271 Jul 04 09:32:22.526190 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 550/1086] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:22 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:23.082030 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-0b72a173-737b-4c1c-a1b7-ce091b396621 req-4b5e88fa-66ad-4e94-ac39-8ec02a980b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d", "tag": "5d507028-e33b-4011-b284-d37d63e22df5"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:32:23.093088 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-0b72a173-737b-4c1c-a1b7-ce091b396621 req-4b5e88fa-66ad-4e94-ac39-8ec02a980b0f service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:23.093643 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-0b72a173-737b-4c1c-a1b7-ce091b396621 req-4b5e88fa-66ad-4e94-ac39-8ec02a980b0f service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:23.116371 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-0b72a173-737b-4c1c-a1b7-ce091b396621 req-4b5e88fa-66ad-4e94-ac39-8ec02a980b0f service nova] Creating event network-changed:5d507028-e33b-4011-b284-d37d63e22df5 for instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d on hv-cinder-84456 Jul 04 09:32:23.121748 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-0b72a173-737b-4c1c-a1b7-ce091b396621 req-4b5e88fa-66ad-4e94-ac39-8ec02a980b0f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043817 Jul 04 09:32:23.122634 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 537/1087] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:32:23.542464 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-52d12a4b-8ad9-4b21-8dba-b9c3e7df23db tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:23.543069 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-52d12a4b-8ad9-4b21-8dba-b9c3e7df23db tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:23.549715 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-52d12a4b-8ad9-4b21-8dba-b9c3e7df23db tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:23.550167 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-52d12a4b-8ad9-4b21-8dba-b9c3e7df23db tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:23.550944 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-52d12a4b-8ad9-4b21-8dba-b9c3e7df23db tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:23.551383 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-52d12a4b-8ad9-4b21-8dba-b9c3e7df23db tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:23.680195 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-52d12a4b-8ad9-4b21-8dba-b9c3e7df23db tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:23.687639 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-52d12a4b-8ad9-4b21-8dba-b9c3e7df23db tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.149105 Jul 04 09:32:23.688200 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 551/1088] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:23 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:24.705927 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-907772cb-68a5-455a-9a4b-3502ba3d6013 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:24.706630 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-907772cb-68a5-455a-9a4b-3502ba3d6013 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:24.713184 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-907772cb-68a5-455a-9a4b-3502ba3d6013 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:24.713636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-907772cb-68a5-455a-9a4b-3502ba3d6013 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:24.714401 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-907772cb-68a5-455a-9a4b-3502ba3d6013 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:24.714838 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-907772cb-68a5-455a-9a4b-3502ba3d6013 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:24.850342 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-907772cb-68a5-455a-9a4b-3502ba3d6013 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:24.858066 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-907772cb-68a5-455a-9a4b-3502ba3d6013 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.156818 Jul 04 09:32:24.858635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 538/1089] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:24 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:25.874848 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-ff811a19-6149-4da9-843c-dfaf74011f6d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:25.875493 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-ff811a19-6149-4da9-843c-dfaf74011f6d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:25.882980 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ff811a19-6149-4da9-843c-dfaf74011f6d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:25.883439 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ff811a19-6149-4da9-843c-dfaf74011f6d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:25.884209 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ff811a19-6149-4da9-843c-dfaf74011f6d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:25.884654 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-ff811a19-6149-4da9-843c-dfaf74011f6d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:26.017718 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-ff811a19-6149-4da9-843c-dfaf74011f6d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:26.027016 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-ff811a19-6149-4da9-843c-dfaf74011f6d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.155778 Jul 04 09:32:26.028036 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 552/1090] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:25 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:27.046188 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-39a40539-2b3b-437a-92d2-cc49387bad5b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:27.046797 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-39a40539-2b3b-437a-92d2-cc49387bad5b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:27.054617 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-39a40539-2b3b-437a-92d2-cc49387bad5b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:27.055060 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-39a40539-2b3b-437a-92d2-cc49387bad5b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:27.055855 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-39a40539-2b3b-437a-92d2-cc49387bad5b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:27.056292 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-39a40539-2b3b-437a-92d2-cc49387bad5b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:27.187651 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-39a40539-2b3b-437a-92d2-cc49387bad5b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:27.195675 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-39a40539-2b3b-437a-92d2-cc49387bad5b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.153594 Jul 04 09:32:27.196238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 539/1091] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:27 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:28.214659 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-29d111a2-998b-4844-a41a-0fa37694ee6f tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:28.220061 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-29d111a2-998b-4844-a41a-0fa37694ee6f tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:28.227263 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-29d111a2-998b-4844-a41a-0fa37694ee6f tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:28.227723 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-29d111a2-998b-4844-a41a-0fa37694ee6f tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:28.228509 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-29d111a2-998b-4844-a41a-0fa37694ee6f tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:28.228951 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-29d111a2-998b-4844-a41a-0fa37694ee6f tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:28.370594 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-29d111a2-998b-4844-a41a-0fa37694ee6f tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:28.378400 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-29d111a2-998b-4844-a41a-0fa37694ee6f tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.167656 Jul 04 09:32:28.378989 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 553/1092] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:28 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:29.395161 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-c8164df5-98db-4592-86d7-56bab8288dc1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:29.395560 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-c8164df5-98db-4592-86d7-56bab8288dc1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:29.402655 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c8164df5-98db-4592-86d7-56bab8288dc1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:29.403113 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c8164df5-98db-4592-86d7-56bab8288dc1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:29.403880 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c8164df5-98db-4592-86d7-56bab8288dc1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:29.404319 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-c8164df5-98db-4592-86d7-56bab8288dc1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:29.543715 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-c8164df5-98db-4592-86d7-56bab8288dc1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:29.551195 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-c8164df5-98db-4592-86d7-56bab8288dc1 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.160194 Jul 04 09:32:29.551744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 540/1093] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:29 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:30.568329 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-301465fe-6b84-4451-b96e-b66eb6bdad1e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:30.568887 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-301465fe-6b84-4451-b96e-b66eb6bdad1e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:30.571390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell0:SELECT=2 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:30.577058 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-301465fe-6b84-4451-b96e-b66eb6bdad1e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:30.577533 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-301465fe-6b84-4451-b96e-b66eb6bdad1e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:30.578307 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-301465fe-6b84-4451-b96e-b66eb6bdad1e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:30.578748 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-301465fe-6b84-4451-b96e-b66eb6bdad1e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:30.711696 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-301465fe-6b84-4451-b96e-b66eb6bdad1e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:30.719445 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-301465fe-6b84-4451-b96e-b66eb6bdad1e tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.155159 Jul 04 09:32:30.720007 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 554/1094] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:30 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:31.736008 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-847f37a7-4ac7-4ef8-8bd8-49d1d857099d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:31.736635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-847f37a7-4ac7-4ef8-8bd8-49d1d857099d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:31.738698 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=2 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:31.739451 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell0:SELECT=6 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:32:31.746327 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-847f37a7-4ac7-4ef8-8bd8-49d1d857099d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:31.746789 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-847f37a7-4ac7-4ef8-8bd8-49d1d857099d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:31.747571 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-847f37a7-4ac7-4ef8-8bd8-49d1d857099d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:31.748017 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-847f37a7-4ac7-4ef8-8bd8-49d1d857099d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:31.881317 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-847f37a7-4ac7-4ef8-8bd8-49d1d857099d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:31.888768 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-847f37a7-4ac7-4ef8-8bd8-49d1d857099d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.156754 Jul 04 09:32:31.889353 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 541/1095] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:31 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:32:32.905934 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-adc20a3f-a0cb-4ae6-aeef-8c58634ada9a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:32.906569 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-adc20a3f-a0cb-4ae6-aeef-8c58634ada9a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:32.913744 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-adc20a3f-a0cb-4ae6-aeef-8c58634ada9a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:32.914232 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-adc20a3f-a0cb-4ae6-aeef-8c58634ada9a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:32.915005 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-adc20a3f-a0cb-4ae6-aeef-8c58634ada9a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:32.915447 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-adc20a3f-a0cb-4ae6-aeef-8c58634ada9a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:33.044843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-adc20a3f-a0cb-4ae6-aeef-8c58634ada9a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:33.053490 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-adc20a3f-a0cb-4ae6-aeef-8c58634ada9a tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.151415 Jul 04 09:32:33.054057 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 555/1096] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:32 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:33.699481 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-ea38f52f-130c-476c-a284-467f931c8b9c req-af2cf0c1-fbc9-4c26-9ad3-542d10c6e24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d", "name": "network-vif-plugged", "status": "completed", "tag": "5d507028-e33b-4011-b284-d37d63e22df5"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:32:33.709987 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ea38f52f-130c-476c-a284-467f931c8b9c req-af2cf0c1-fbc9-4c26-9ad3-542d10c6e24f service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:33.710657 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ea38f52f-130c-476c-a284-467f931c8b9c req-af2cf0c1-fbc9-4c26-9ad3-542d10c6e24f service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:33.722414 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-ea38f52f-130c-476c-a284-467f931c8b9c req-af2cf0c1-fbc9-4c26-9ad3-542d10c6e24f service nova] Creating event network-vif-plugged:5d507028-e33b-4011-b284-d37d63e22df5 for instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d on hv-cinder-84456 Jul 04 09:32:33.727366 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-ea38f52f-130c-476c-a284-467f931c8b9c req-af2cf0c1-fbc9-4c26-9ad3-542d10c6e24f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031593 Jul 04 09:32:33.727950 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 542/1097] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:32:34.070935 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-3b28a6f1-a0ed-4622-887c-99597f363683 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:34.071506 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-3b28a6f1-a0ed-4622-887c-99597f363683 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:34.078050 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3b28a6f1-a0ed-4622-887c-99597f363683 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:34.078505 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3b28a6f1-a0ed-4622-887c-99597f363683 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:34.079275 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3b28a6f1-a0ed-4622-887c-99597f363683 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:34.079717 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-3b28a6f1-a0ed-4622-887c-99597f363683 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:34.212442 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-3b28a6f1-a0ed-4622-887c-99597f363683 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:34.220315 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-3b28a6f1-a0ed-4622-887c-99597f363683 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1266 microversion: 2.1 time: 0.154187 Jul 04 09:32:34.220878 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 556/1098] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:34 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:35.240037 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-382368f3-f533-4b32-a197-2196015088a0 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:35.240968 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-382368f3-f533-4b32-a197-2196015088a0 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:35.247238 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-382368f3-f533-4b32-a197-2196015088a0 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:35.247692 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-382368f3-f533-4b32-a197-2196015088a0 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:35.248456 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-382368f3-f533-4b32-a197-2196015088a0 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:35.248894 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-382368f3-f533-4b32-a197-2196015088a0 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:35.387519 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-382368f3-f533-4b32-a197-2196015088a0 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:35.395237 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-382368f3-f533-4b32-a197-2196015088a0 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1452 microversion: 2.1 time: 0.161169 Jul 04 09:32:35.395801 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 543/1099] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:35 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:35.412451 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-04e20568-5a92-4cef-9b92-5d94afd301f5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:32:35.413091 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-04e20568-5a92-4cef-9b92-5d94afd301f5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:32:35.419502 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04e20568-5a92-4cef-9b92-5d94afd301f5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:35.419949 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04e20568-5a92-4cef-9b92-5d94afd301f5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:35.420706 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04e20568-5a92-4cef-9b92-5d94afd301f5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:35.421172 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-04e20568-5a92-4cef-9b92-5d94afd301f5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:35.554818 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-04e20568-5a92-4cef-9b92-5d94afd301f5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:32:35.562325 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-04e20568-5a92-4cef-9b92-5d94afd301f5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1452 microversion: 2.1 time: 0.154283 Jul 04 09:32:35.562901 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 557/1100] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:32:35 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:32:37.119582 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-ae6ada0f-e60c-4a75-9f52-a2a6e260d382 req-1bdaa7fe-f97d-4ffd-b8be-5e39d2754ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d", "tag": "5d507028-e33b-4011-b284-d37d63e22df5"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:32:37.128265 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ae6ada0f-e60c-4a75-9f52-a2a6e260d382 req-1bdaa7fe-f97d-4ffd-b8be-5e39d2754ad0 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:32:37.128783 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ae6ada0f-e60c-4a75-9f52-a2a6e260d382 req-1bdaa7fe-f97d-4ffd-b8be-5e39d2754ad0 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:32:37.140444 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-ae6ada0f-e60c-4a75-9f52-a2a6e260d382 req-1bdaa7fe-f97d-4ffd-b8be-5e39d2754ad0 service nova] Creating event network-changed:5d507028-e33b-4011-b284-d37d63e22df5 for instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d on hv-cinder-84456 Jul 04 09:32:37.145535 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-ae6ada0f-e60c-4a75-9f52-a2a6e260d382 req-1bdaa7fe-f97d-4ffd-b8be-5e39d2754ad0 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029711 Jul 04 09:32:37.146186 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 544/1101] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:32:44.052293 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:32:44.052994 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Mon Jul 4 09:32:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:34:05.176641 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_api:SELECT=20 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:05.178375 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG dbcounter [-] [117665] Writing DB stats nova_cell1:SELECT=48 {{(pid=117665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:05.179860 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:05.180685 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG dbcounter [-] [117664] Writing DB stats nova_cell1:SELECT=44 {{(pid=117664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 09:34:05.183488 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-0ec6f125-3462-4894-86ca-dccb615edf13 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:05.184452 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0ec6f125-3462-4894-86ca-dccb615edf13 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:05.188677 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-6cb1a0e8-8672-4d4b-a398-59a3d6eb9106 req-1539e057-5dd2-4014-8142-650100bfa640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d", "tag": "5d507028-e33b-4011-b284-d37d63e22df5"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:34:05.194185 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ec6f125-3462-4894-86ca-dccb615edf13 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:05.194653 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ec6f125-3462-4894-86ca-dccb615edf13 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:05.195449 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ec6f125-3462-4894-86ca-dccb615edf13 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:05.195898 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-0ec6f125-3462-4894-86ca-dccb615edf13 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:05.199205 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-6cb1a0e8-8672-4d4b-a398-59a3d6eb9106 req-1539e057-5dd2-4014-8142-650100bfa640 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:05.199679 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-6cb1a0e8-8672-4d4b-a398-59a3d6eb9106 req-1539e057-5dd2-4014-8142-650100bfa640 service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:05.214378 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-6cb1a0e8-8672-4d4b-a398-59a3d6eb9106 req-1539e057-5dd2-4014-8142-650100bfa640 service nova] Creating event network-changed:5d507028-e33b-4011-b284-d37d63e22df5 for instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d on hv-cinder-84456 Jul 04 09:34:05.219635 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-6cb1a0e8-8672-4d4b-a398-59a3d6eb9106 req-1539e057-5dd2-4014-8142-650100bfa640 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042956 Jul 04 09:34:05.220440 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 545/1102] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 09:34:05.223220 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-0ec6f125-3462-4894-86ca-dccb615edf13 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:34:05.331039 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-0ec6f125-3462-4894-86ca-dccb615edf13 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "DELETE /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 204 len: 0 microversion: 2.1 time: 0.156291 Jul 04 09:34:05.332208 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 558/1103] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:34:05 2022] DELETE /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 09:34:05.341921 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-99178518-2b0c-4dc8-9841-7e84d6777790 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:05.342768 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-99178518-2b0c-4dc8-9841-7e84d6777790 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:05.350428 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-99178518-2b0c-4dc8-9841-7e84d6777790 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:05.351076 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-99178518-2b0c-4dc8-9841-7e84d6777790 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:05.351946 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-99178518-2b0c-4dc8-9841-7e84d6777790 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:05.352496 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-99178518-2b0c-4dc8-9841-7e84d6777790 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:05.500758 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-99178518-2b0c-4dc8-9841-7e84d6777790 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:34:05.510749 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-99178518-2b0c-4dc8-9841-7e84d6777790 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1576 microversion: 2.1 time: 0.173126 Jul 04 09:34:05.513081 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 546/1104] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:34:05 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:34:06.528385 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-f789818f-1cf4-4c08-b175-337fc69c9010 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:06.529113 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-f789818f-1cf4-4c08-b175-337fc69c9010 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:06.535641 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f789818f-1cf4-4c08-b175-337fc69c9010 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:06.536097 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f789818f-1cf4-4c08-b175-337fc69c9010 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:06.536983 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f789818f-1cf4-4c08-b175-337fc69c9010 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:06.537542 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-f789818f-1cf4-4c08-b175-337fc69c9010 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:06.674171 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-f789818f-1cf4-4c08-b175-337fc69c9010 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:34:06.682562 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-f789818f-1cf4-4c08-b175-337fc69c9010 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1576 microversion: 2.1 time: 0.158328 Jul 04 09:34:06.683134 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 559/1105] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:34:06 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:34:07.668211 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-c0dd764a-8520-4879-b789-af21fb07c656 req-e14d54df-dcae-4068-9bb9-1fa15c54565c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d", "name": "network-vif-deleted", "tag": "5d507028-e33b-4011-b284-d37d63e22df5"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:34:07.678168 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c0dd764a-8520-4879-b789-af21fb07c656 req-e14d54df-dcae-4068-9bb9-1fa15c54565c service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:07.678653 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-c0dd764a-8520-4879-b789-af21fb07c656 req-e14d54df-dcae-4068-9bb9-1fa15c54565c service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:07.691974 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-c0dd764a-8520-4879-b789-af21fb07c656 req-e14d54df-dcae-4068-9bb9-1fa15c54565c service nova] Creating event network-vif-deleted:5d507028-e33b-4011-b284-d37d63e22df5 for instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d on hv-cinder-84456 Jul 04 09:34:07.698003 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-c0dd764a-8520-4879-b789-af21fb07c656 req-e14d54df-dcae-4068-9bb9-1fa15c54565c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033696 Jul 04 09:34:07.699011 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 547/1106] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:34:07.700309 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-75e18130-3324-4529-ad78-0b299cc24f8d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:07.701117 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-75e18130-3324-4529-ad78-0b299cc24f8d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:07.712084 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75e18130-3324-4529-ad78-0b299cc24f8d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:07.712924 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75e18130-3324-4529-ad78-0b299cc24f8d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:07.713819 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75e18130-3324-4529-ad78-0b299cc24f8d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:07.714390 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-75e18130-3324-4529-ad78-0b299cc24f8d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:07.779336 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-75e18130-3324-4529-ad78-0b299cc24f8d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:34:07.788077 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-75e18130-3324-4529-ad78-0b299cc24f8d tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 200 len: 1226 microversion: 2.1 time: 0.091011 Jul 04 09:34:07.788636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 560/1107] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:34:07 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 09:34:08.805347 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-81a51c76-e6f3-4812-95dc-12be90c8e6e5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:08.806047 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-81a51c76-e6f3-4812-95dc-12be90c8e6e5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:08.812799 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81a51c76-e6f3-4812-95dc-12be90c8e6e5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:08.813282 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81a51c76-e6f3-4812-95dc-12be90c8e6e5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:08.814049 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81a51c76-e6f3-4812-95dc-12be90c8e6e5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:08.814488 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-81a51c76-e6f3-4812-95dc-12be90c8e6e5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:08.827485 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-81a51c76-e6f3-4812-95dc-12be90c8e6e5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] HTTP exception thrown: Instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d could not be found. Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-81a51c76-e6f3-4812-95dc-12be90c8e6e5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Request method failure captured: Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d HTTP/1.1 Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrKNVeWn0iaQ7wj-WY173DlLrmxKpwMjXsnF8ELOykl559wLT0wlKW7g86KGKxrcG1W4L-qfi0rxyWei6xFSsFFKbIBBPDDSaDYdqenIns4mAtOeY_WNIMIgJEKcTkVLO4M1HWf9jWSHeM-sFTE5fba_RqnM4jgyP0ZoUqXJ7ALmuwA Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 4fe236d825ae40f793bf2a5bccedc3cd Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:34:08.829110 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_4fe236d825ae40f793bf2a5bccedc3cd", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 4fe236d825ae40f793bf2a5bccedc3cd Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-TestVolumeBootPattern-1296990484-project Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 70733d7f6b8b42a39425ebc94e1ec1f4 Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestVolumeBootPattern-1296990484-project Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d could not be found. Jul 04 09:34:08.830831 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d'} Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d could not be found. Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:34:08.831896 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d could not be found. Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d could not be found. Jul 04 09:34:08.834171 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:08.835777 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-81a51c76-e6f3-4812-95dc-12be90c8e6e5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Returning 404 to user: Instance bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:34:08.835777 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-81a51c76-e6f3-4812-95dc-12be90c8e6e5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d" status: 404 len: 111 microversion: 2.1 time: 0.029513 Jul 04 09:34:08.835777 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 548/1108] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:34:08 2022] GET /compute/v2.1/servers/bf9e2a51-02a5-498d-af3a-0bebcb5c0d4d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:34:11.882851 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-a62fc5c6-80e4-424b-bf0c-1d8cbe6bb6d5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:11.883359 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a62fc5c6-80e4-424b-bf0c-1d8cbe6bb6d5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:11.890177 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a62fc5c6-80e4-424b-bf0c-1d8cbe6bb6d5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:11.890725 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a62fc5c6-80e4-424b-bf0c-1d8cbe6bb6d5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:11.891537 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-dd1b6162-fda5-44a9-8ebb-3aab8fcbdf1c req-bb3998ed-2d2b-4eeb-9479-fde0a40c1a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f135b80-2a92-4714-812f-5692ed1bc5f7", "tag": "81e35a72-e596-4281-9d19-1c373585ceeb"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:34:11.891998 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a62fc5c6-80e4-424b-bf0c-1d8cbe6bb6d5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:11.892172 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-a62fc5c6-80e4-424b-bf0c-1d8cbe6bb6d5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:11.899910 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-dd1b6162-fda5-44a9-8ebb-3aab8fcbdf1c req-bb3998ed-2d2b-4eeb-9479-fde0a40c1a3c service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:11.900364 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-dd1b6162-fda5-44a9-8ebb-3aab8fcbdf1c req-bb3998ed-2d2b-4eeb-9479-fde0a40c1a3c service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:11.913636 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-dd1b6162-fda5-44a9-8ebb-3aab8fcbdf1c req-bb3998ed-2d2b-4eeb-9479-fde0a40c1a3c service nova] Creating event network-changed:81e35a72-e596-4281-9d19-1c373585ceeb for instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 on hv-cinder-84456 Jul 04 09:34:11.918420 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-a62fc5c6-80e4-424b-bf0c-1d8cbe6bb6d5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Going to try to terminate instance {{(pid=117665) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 09:34:11.918783 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-dd1b6162-fda5-44a9-8ebb-3aab8fcbdf1c req-bb3998ed-2d2b-4eeb-9479-fde0a40c1a3c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030996 Jul 04 09:34:11.919829 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 549/1109] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:34:12.007660 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-a62fc5c6-80e4-424b-bf0c-1d8cbe6bb6d5 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "DELETE /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 204 len: 0 microversion: 2.1 time: 0.129132 Jul 04 09:34:12.008629 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 561/1110] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:34:11 2022] DELETE /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 09:34:12.018237 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-106bd514-c701-45db-a57c-ddde2089ef77 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:12.019040 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-106bd514-c701-45db-a57c-ddde2089ef77 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:12.025744 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-106bd514-c701-45db-a57c-ddde2089ef77 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:12.026291 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-106bd514-c701-45db-a57c-ddde2089ef77 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:12.027582 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-106bd514-c701-45db-a57c-ddde2089ef77 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:12.028270 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-106bd514-c701-45db-a57c-ddde2089ef77 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:12.171420 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.policy [None req-106bd514-c701-45db-a57c-ddde2089ef77 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117664) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:34:12.179858 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-106bd514-c701-45db-a57c-ddde2089ef77 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1576 microversion: 2.1 time: 0.166013 Jul 04 09:34:12.180423 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 550/1111] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:34:12 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:34:13.198137 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-c883b7d7-a45d-42a5-b1ee-ba591f8c8be3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:13.198843 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-c883b7d7-a45d-42a5-b1ee-ba591f8c8be3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:13.205299 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c883b7d7-a45d-42a5-b1ee-ba591f8c8be3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:13.205758 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c883b7d7-a45d-42a5-b1ee-ba591f8c8be3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:13.206520 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c883b7d7-a45d-42a5-b1ee-ba591f8c8be3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:13.206963 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-c883b7d7-a45d-42a5-b1ee-ba591f8c8be3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:13.338518 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-c883b7d7-a45d-42a5-b1ee-ba591f8c8be3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:34:13.346101 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-c883b7d7-a45d-42a5-b1ee-ba591f8c8be3 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1576 microversion: 2.1 time: 0.152206 Jul 04 09:34:13.346677 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 562/1112] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:34:13 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:34:13.659932 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:34:13.660542 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Mon Jul 4 09:34:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:34:13.971361 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [req-ff2e5c31-3e4d-4265-bccd-471e9d911db6 req-6ba10853-f8bd-4954-a1da-9986bd4de44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f135b80-2a92-4714-812f-5692ed1bc5f7", "name": "network-vif-deleted", "tag": "81e35a72-e596-4281-9d19-1c373585ceeb"}]} {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 09:34:13.981307 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ff2e5c31-3e4d-4265-bccd-471e9d911db6 req-6ba10853-f8bd-4954-a1da-9986bd4de44b service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:13.982007 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [req-ff2e5c31-3e4d-4265-bccd-471e9d911db6 req-6ba10853-f8bd-4954-a1da-9986bd4de44b service nova] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:13.994015 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.compute.server_external_events [req-ff2e5c31-3e4d-4265-bccd-471e9d911db6 req-6ba10853-f8bd-4954-a1da-9986bd4de44b service nova] Creating event network-vif-deleted:81e35a72-e596-4281-9d19-1c373585ceeb for instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 on hv-cinder-84456 Jul 04 09:34:13.998627 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [req-ff2e5c31-3e4d-4265-bccd-471e9d911db6 req-6ba10853-f8bd-4954-a1da-9986bd4de44b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031077 Jul 04 09:34:13.999200 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 551/1113] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 4 09:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 09:34:14.364713 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:14.365708 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:14.374082 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:14.374534 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:14.375625 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:14.376287 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:14.410107 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:14.410568 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:14.411040 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.objects.instance [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lazy-loading 'fault' on Instance uuid 5f135b80-2a92-4714-812f-5692ed1bc5f7 {{(pid=117665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 09:34:14.451239 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.policy [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70733d7f6b8b42a39425ebc94e1ec1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe236d825ae40f793bf2a5bccedc3cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117665) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 09:34:14.459283 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-b52c4aa5-478b-4c8a-b975-f3e0bdc27896 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 200 len: 1230 microversion: 2.1 time: 0.099719 Jul 04 09:34:14.459866 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 563/1114] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:34:14 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 09:34:15.478188 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-95f860f4-5a65-48fc-b638-4061dc73244b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:15.478884 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-95f860f4-5a65-48fc-b638-4061dc73244b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: 5f135b80-2a92-4714-812f-5692ed1bc5f7] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:15.485106 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95f860f4-5a65-48fc-b638-4061dc73244b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:15.485563 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95f860f4-5a65-48fc-b638-4061dc73244b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:15.486332 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95f860f4-5a65-48fc-b638-4061dc73244b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:15.486770 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-95f860f4-5a65-48fc-b638-4061dc73244b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:15.499738 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-95f860f4-5a65-48fc-b638-4061dc73244b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] HTTP exception thrown: Instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 could not be found. Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-95f860f4-5a65-48fc-b638-4061dc73244b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Request method failure captured: Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 HTTP/1.1 Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrKNVeWn0iaQ7wj-WY173DlLrmxKpwMjXsnF8ELOykl559wLT0wlKW7g86KGKxrcG1W4L-qfi0rxyWei6xFSsFFKbIBBPDDSaDYdqenIns4mAtOeY_WNIMIgJEKcTkVLO4M1HWf9jWSHeM-sFTE5fba_RqnM4jgyP0ZoUqXJ7ALmuwA Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 4fe236d825ae40f793bf2a5bccedc3cd Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:34:15.501369 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_4fe236d825ae40f793bf2a5bccedc3cd", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 4fe236d825ae40f793bf2a5bccedc3cd Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-TestVolumeBootPattern-1296990484-project Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 70733d7f6b8b42a39425ebc94e1ec1f4 Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestVolumeBootPattern-1296990484-project Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 could not be found. Jul 04 09:34:15.503198 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': '5f135b80-2a92-4714-812f-5692ed1bc5f7'} Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 could not be found. Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:34:15.504285 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 could not be found. Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 could not be found. Jul 04 09:34:15.506118 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:15.508417 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-95f860f4-5a65-48fc-b638-4061dc73244b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Returning 404 to user: Instance 5f135b80-2a92-4714-812f-5692ed1bc5f7 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:34:15.508417 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-95f860f4-5a65-48fc-b638-4061dc73244b tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7" status: 404 len: 111 microversion: 2.1 time: 0.030058 Jul 04 09:34:15.508417 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 552/1115] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:34:15 2022] GET /compute/v2.1/servers/5f135b80-2a92-4714-812f-5692ed1bc5f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:34:15.949673 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1e119eb5-a478-4cac-93d7-4a6e712cdadd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:15.950187 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.compute.api [None req-1e119eb5-a478-4cac-93d7-4a6e712cdadd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117665) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:15.956484 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e119eb5-a478-4cac-93d7-4a6e712cdadd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:15.956945 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e119eb5-a478-4cac-93d7-4a6e712cdadd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:15.957747 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e119eb5-a478-4cac-93d7-4a6e712cdadd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:15.958749 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG oslo_concurrency.lockutils [None req-1e119eb5-a478-4cac-93d7-4a6e712cdadd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:15.974083 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.wsgi [None req-1e119eb5-a478-4cac-93d7-4a6e712cdadd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] HTTP exception thrown: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1e119eb5-a478-4cac-93d7-4a6e712cdadd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Request method failure captured: Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: request: DELETE /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 HTTP/1.1 Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept: application/json Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Accept-Encoding: identity Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Connection: close Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Length: 0 Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Content-Type: application/json Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Host: 10.222.0.71 Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Openstack-System-Scope: None Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: User-Agent: python-urllib3/1.26.9 Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Auth-Token: gAAAAABiwrKNVeWn0iaQ7wj-WY173DlLrmxKpwMjXsnF8ELOykl559wLT0wlKW7g86KGKxrcG1W4L-qfi0rxyWei6xFSsFFKbIBBPDDSaDYdqenIns4mAtOeY_WNIMIgJEKcTkVLO4M1HWf9jWSHeM-sFTE5fba_RqnM4jgyP0ZoUqXJ7ALmuwA Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Id: None Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Domain-Name: None Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Identity-Status: Confirmed Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Is-Admin-Project: True Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Id: default Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Domain-Name: Default Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Id: 4fe236d825ae40f793bf2a5bccedc3cd Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Project-Name: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Role: member,reader Jul 04 09:34:15.975770 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Roles: member,reader Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_4fe236d825ae40f793bf2a5bccedc3cd", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Id: 4fe236d825ae40f793bf2a5bccedc3cd Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-Tenant-Name: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User: tempest-TestVolumeBootPattern-1296990484-project Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Id: default Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Domain-Name: Default Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Id: 70733d7f6b8b42a39425ebc94e1ec1f4 Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: X-User-Name: tempest-TestVolumeBootPattern-1296990484-project Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: method: > Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: exception: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:34:15.977636 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: action_args: {'id': 'ee3a79da-9564-4eed-8be7-970da53166b0'} Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:34:15.978615 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:34:15.980247 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: ERROR nova.api.openstack.wsgi Jul 04 09:34:15.981917 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-1e119eb5-a478-4cac-93d7-4a6e712cdadd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Returning 404 to user: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. {{(pid=117665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:34:15.981917 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-1e119eb5-a478-4cac-93d7-4a6e712cdadd tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "DELETE /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 404 len: 111 microversion: 2.1 time: 0.031627 Jul 04 09:34:15.981917 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 564/1116] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 4 09:34:15 2022] DELETE /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:34:15.988159 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d72180de-55c8-4bd9-8bdf-3dc348918a07 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '>' {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:15.988881 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.compute.api [None req-d72180de-55c8-4bd9-8bdf-3dc348918a07 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] [instance: ee3a79da-9564-4eed-8be7-970da53166b0] Fetching instance by UUID {{(pid=117664) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 09:34:15.995056 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d72180de-55c8-4bd9-8bdf-3dc348918a07 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:15.995514 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d72180de-55c8-4bd9-8bdf-3dc348918a07 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:15.996290 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d72180de-55c8-4bd9-8bdf-3dc348918a07 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 09:34:15.996736 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG oslo_concurrency.lockutils [None req-d72180de-55c8-4bd9-8bdf-3dc348918a07 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Lock "ac196d60-a3f3-44cc-90e3-79ce8ad134b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 09:34:16.012062 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.wsgi [None req-d72180de-55c8-4bd9-8bdf-3dc348918a07 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] HTTP exception thrown: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d72180de-55c8-4bd9-8bdf-3dc348918a07 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Request method failure captured: Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: request: GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 HTTP/1.1 Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept: application/json Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Accept-Encoding: identity Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Connection: close Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Length: 0 Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Content-Type: application/json Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Host: 10.222.0.71 Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Openstack-System-Scope: None Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: User-Agent: python-urllib3/1.26.9 Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Auth-Token: gAAAAABiwrKNVeWn0iaQ7wj-WY173DlLrmxKpwMjXsnF8ELOykl559wLT0wlKW7g86KGKxrcG1W4L-qfi0rxyWei6xFSsFFKbIBBPDDSaDYdqenIns4mAtOeY_WNIMIgJEKcTkVLO4M1HWf9jWSHeM-sFTE5fba_RqnM4jgyP0ZoUqXJ7ALmuwA Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Id: None Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Domain-Name: None Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Identity-Status: Confirmed Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Is-Admin-Project: True Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Id: default Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Domain-Name: Default Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Id: 4fe236d825ae40f793bf2a5bccedc3cd Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Project-Name: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Role: member,reader Jul 04 09:34:16.013652 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Roles: member,reader Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/4fe236d825ae40f793bf2a5bccedc3cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_4fe236d825ae40f793bf2a5bccedc3cd", "adminURL": "http://10.222.0.71:8080"}]}] Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Id: 4fe236d825ae40f793bf2a5bccedc3cd Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1296990484 Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User: tempest-TestVolumeBootPattern-1296990484-project Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Id: default Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Domain-Name: Default Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Id: 70733d7f6b8b42a39425ebc94e1ec1f4 Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: X-User-Name: tempest-TestVolumeBootPattern-1296990484-project Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: method: > Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: exception: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:34:16.015455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: action_args: {'id': 'ee3a79da-9564-4eed-8be7-970da53166b0'} Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: {{(pid=117664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 09:34:16.016455 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. Jul 04 09:34:16.018121 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: ERROR nova.api.openstack.wsgi Jul 04 09:34:16.019545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: DEBUG nova.api.openstack.wsgi [None req-d72180de-55c8-4bd9-8bdf-3dc348918a07 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Returning 404 to user: Instance ee3a79da-9564-4eed-8be7-970da53166b0 could not be found. {{(pid=117664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 09:34:16.019545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO nova.api.openstack.requestlog [None req-d72180de-55c8-4bd9-8bdf-3dc348918a07 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0" status: 404 len: 111 microversion: 2.1 time: 0.030713 Jul 04 09:34:16.019545 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: [pid: 117664|app: 0|req: 553/1117] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 4 09:34:15 2022] GET /compute/v2.1/servers/ee3a79da-9564-4eed-8be7-970da53166b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 09:34:17.308543 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: DEBUG nova.api.openstack.wsgi [None req-81701a82-791a-42ea-97fb-62f203a21227 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] Calling method '.version_select at 0x7fad7aca9ca0>' {{(pid=117665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 09:34:17.327696 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO nova.api.openstack.requestlog [None req-81701a82-791a-42ea-97fb-62f203a21227 tempest-TestVolumeBootPattern-1296990484 tempest-TestVolumeBootPattern-1296990484-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1745159673" status: 202 len: 0 microversion: 2.1 time: 0.022977 Jul 04 09:34:17.328278 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: [pid: 117665|app: 0|req: 565/1118] 10.222.0.71 () {58 vars in 1262 bytes} [Mon Jul 4 09:34:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1745159673 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 09:36:04.060893 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:36:04.061697 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Mon Jul 4 09:36:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:37:33.670431 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:37:33.670909 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Mon Jul 4 09:37:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:37:44.613589 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:37:44.614243 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Mon Jul 4 09:37:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:39:17.507609 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:39:17.508145 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Mon Jul 4 09:39:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:39:24.069470 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:39:24.070091 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Mon Jul 4 09:39:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:39:42.563347 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:39:42.563945 dv-cinder-844563-4-iscsi devstack@n-api.service[117664]: Mon Jul 4 09:39:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 09:39:44.919272 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 09:39:44.919871 dv-cinder-844563-4-iscsi devstack@n-api.service[117665]: Mon Jul 4 09:39:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!